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The Effect the Precision 
Informational Feedback Human 
Tracking Performance, 


DARWIN HUNT, Behavioral Sciences Laboratory, Wright Air Development Division. 


Research was conducted determine human operator abilities compensatory 
tracking task function the precision the displayed error information for 
various levels task difficulty and practice. The controller dynamics were not 
varied and were such that displacements the control were integrated twice before 
affecting the tracking error. Tracking error and the extent control motion 
were the criterion measures. The results suggest that (a) increases the precision 
displayed error information result negatively accelerated reduction the 
tracking error; (b) the operator becomes more proficient, the relative superiority 
increased precision displayed error reduced; (c) the effects the precision 
information control motion depends upon the difficulty the task; and 
the amount control motion generally decreases the operator becomes more 
proficient and the magnitude this decrease greater for task than 


task. 


INTRODUCTION 


system, can perform his tasks only effectively 
the information made available him will 
permit. some cases, simple indication 
whether system parameter within certain 
limits, i.e. display, sufficient. 
Other situations require the display informa- 
tion concerning not only whether the para- 
meter has exceeded the limits, but also the 
direction this excess. still other tasks, 
information related the existence, direction, 
and magnitude out-of-limits condition 
must displayed the operator ac- 
ceptable level over-all system performance 
attained. this latter situation, question 
that arises is, what degree precision 
(resolution specificity) should the informa- 
tion concerning ‘error’ magnitude pre- 
sented that optimal performance will 
realized 

the present time, the degree specificity 
the information presented the man 
determined largely the availability and 


This paper based research conducted the 
Behavioral Sciences Laboratory, Aerospace Medical 
Division, Wright-Patterson Air Force Base, Ohio, and 
reported more detail WADC Technical Report 
58-584. The comments Dr. John Hornseth are 
gratefully acknowledged. 
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reliability various display techniques; the 
weight, size, and economic penalties involved, 
and the rational determination the utility 
the information the operator. the abilities 
man are used most effectively future 
systems, more sound basis for the considera- 
tion human factors making this design 
decision must provided. The purpose 
this paper contribute knowledge assist 
the designer man-machine systems 
determining the degree precision feedback 
information display the man order 
obtain the optimum output the total system. 
More specifically, this research was designed 
determine the effects feedback precision 
tracking performance and how the effects 
precision are influenced practice and the 
difficulty the tracking task. 


METHOD 
Subjects 


Sixty-four male undergraduate college stu- 
dents were paid serve subjects. None had 
any apparent visual motor deficiencies. 


Apparatus 


The apparatus, which represented 
Fig. consisted essentially target course 
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generator, error transformer, Cathode 
Ray Tube display, lever control, and 
analogue computer. 

The target course generator was designed 
that either two target courses could 
selected for presentation the CRT. The two 
target courses differed only terms 
frequency motion. The “easy” target course 


Target course 
generator 


course course 


Recording 


channel 


Error(e) 


Error transformer 


Number of categories 
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This tracking error (true error) 
transformed accordance with the particular 
condition feedback specificity under which 
given subject was scheduled perform (see 
Fig. 2a, and d). The output the error 
transformer was then fed directly the CRT 
display. 

The subjects display consisted 5-in. 


Recording 
No.4 


Control position(p) 


ray tube 
display 


Recording 
channel No.2 


Recording 
No.3 


Block diagram the experimental tracking apparatus. 


was constructed combining 14, and 
cpm sine waves, the cpm component 
being 180° out phase. This target course 
was traversed once during each trial 
sec duration. obtain the 
target course, the course was traversed 
three times per sec. Thus, the “difficult” 
cpm sine waves. 

The instantaneous difference between the 
output the target course generator and the 
output the control system, i.e. the tracking 
error, was fed into the error transformer. 


Cathode Ray Tube with P-11 (low persis- 
tance) phosphor. The front the CRT, 
except for slot in. high in. wide, was 
covered piece black cardboard. The 
transformed tracking error 
within the slot along the horizontal dimension. 
The zero error position was indicated two 
vertical lines in. apart; these lines were 
centered horizontally the slot 

The control used the subject was lever 
in. length, with rubber grip the top 
portion. The lever could moved the left 
and right but was fixed the fore-aft direction. 
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When force was applied sideward 
direction, spring centering returned the lever 
the center upright position which the 
output the control was effectively zero. 
The base the control was fixed that when 
the control was the neutral position, the top 
the lever was directly front, in. below 
and in. away from the center the display. 

The computer was used insert controller 


in. 


Displayed error, 


True error 


in. 


o 

Qa 

a 


True error 


July, 1961 —79 


second integrating amplifier, the voltage 
across the potentiometer the control lever, 
and time. 

Voltages proportional tracking error (e) 
and control position (p) were obtained the 
points indicated Fig. These voltages were 
fed into the computer which was programmed 
that voltage analogues the integrated 
absolute value the tracking error 


Displayed error, 


True error 


in. 


Displayed error, 


True error 


The four error transformations studied. The displayed error shown inches displacement the 


dot the subject’s display. 


dynamics into the system and also obtain 
criterion measures. Attached the subject’s 
control lever was potentiometer. Across the 
potentiometer was voltage, whose sign and 
magnitude depended upon the direction and 
extent displacement the control lever 
from the center upright position. This voltage 
was fed through two integrating amplifiers, 
series, the computer. The integration rates 
were such that 


(OUT) 


where OUT represents the output the 


and the integrated absolute value the control 
position could obtained for each 
trial. 

order maintain relatively constant 
subject environment, the display, control lever, 
sound shielded booth. was 
provided 3-W neon light located the 
top the wall behind the subject. fan 
mounted opening the ceiling the 
booth provided adequate air circulation, and 
the noise made the fan masked out cues 
such the clicking scoring counters. 
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Procedure 


Two levels task difficulty were studied. 
These corresponded the “easy” and 
frequencies target course motion 
described above. Four degrees specificity 


feedback information were investigated (see 
Fig. 2). 


(a) Three categories—only information con- 
cerning the existence and direction the error 
was displayed the subject (see Fig. 2a). 

(b) Seven categories—information concern- 
ing the direction the error and three indices 
error magnitude either direction were 
presented the subject (see Fig. 2b). 

(c) Thirteen categories—similar (b) except 
that six indices the magnitude the 
tracking error either direction were pre- 
sented the subject (see Fig. 2c). 

(d) Continuous—the error dot moved 
“smoothly” across the CRT display either 
direction from the zero error position direct 
relation the tracking error (see Fig. 2d). 


The sixty-four subjects were randomly as- 
signed, eight each the eight combinations 
task difficulty and feedback specificity. The 
subject performed under his assigned condition 
for two sessions which were held successive 
days, six subjects being tested each day. 
order minimize any biasing effect random 
variability resulting from factors such un- 
controlled environmental conditions and equip- 
ment variations, the following two precautions 
were taken: (a) none the eight experimental 
conditions was represented more than once 
any one day, and (b) each the four degrees 
feedback specificity was represented least 
once each day. 

session consisted fifteen 90-sec trials, 
with 45-sec rest period between each trial 
with one exception, 4-min rest period 
was given between trials and Prior the 
first session, the subject was instructed with 
respect the operation the control, the 
controller dynamics, and the nature the task; 
was also given information concerning the 
trial and rest period durations and the activities 
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permitted during the rest periods. These 
instructions were repeated the subject im- 
mediately prior beginning the second 
session. 

warning buzzer was sounded sec before 
each trial. One second before the trial, the 
controller system was energized. the end 
the trial the buzzer was sounded again, and 
the subject then began his 45-sec rest period, 
during which remained seated and was not 
permitted smoke. During the 4-min rest, the 
subject relaxed outside the experimental booth. 


RESULTS AND DISCUSSION 


The two basic measures performance were 
the integrated absolute error (Tracking Error 
Score) and the integrated absolute control 
position (Control Motion Score). These scores 
were obtained for each subject for each trial. 


Tracking Error 


The mean tracking error performance for 
each trial under each the eight experimental 
conditions (four degrees specificity feed- 
back information two levels task 
culty) was computed. These data are presented 
for the “easy” task Fig. and for the 

First, inspection these data suggest that 
increase the number categories 
presented the subject seems result 
improvement performance. Second, the 
relative improvement associated with in- 
creased number categories appears differ 
depending upon the stage practice. These 
and other relationships were tested 
modified Lindquist* Type III analysis. 

The statistically significant effect the 
number categories 0.001) supports the 
above-mentioned observation that increases 
the number categories result improved 
performance. Inspection Fig. reveals that 
the tracking error decreases monotonically 
with increases the number informational 
categories and that the major reduction 
tracking error associated with increasing the 
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error the “easy” task function practice. Performance each the four informational 


conditions shown separately. Each point the mean tracking error score for the eight subjects that 
performed under that condition. 
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number categories from three seven. 
This improvement performance realized 
increased number informational categor- 
ries was not influenced the difficulty the 
task evidenced the fact that the interaction 
these factors not significant. However, 
the tracking error associated with the 
task generally was less than the error associated 
with the “difficult” task The 


Tracking error 


7 


Number categories infomation 
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continuous condition. Although the design 
the experiment does not permit conclusive 
evaluation tnis interaction, such result 
could accounted for terms the differen- 
tial development inhibitory effects for the 
different informational conditions. 


was originally expected, the basis 
work Ammons,! Bilodeau,? and 
Noble and that the greater the 


task, Ist session 
Easy" task,2nd session 


session 
“Difficult” tosk,2nd session 


Continuous 


Tracking error function the number categories error information. Each point the mean 
tracking error score for each session the eight subjects that performed under each the eight 


lack statistical significance between categories 
and trials, and among sessions, categories, and 
trials suggests that the rates improvement— 
when averaged over sessions (and within 
sessions)—did not differ. 

The main effects sessions and trials and 
the interaction between sessions and categories 
were significant (all The latter 
interaction reflected Figs. and the 
fact that the performance difference between 
Session and Session relatively greater 
for the 3-category condition than for the 


experimental conditions levels task difficulty degrees feedback specificity). 


improvement. 


number categories, the more rapid the rate 
improvement with practice. However, the 
findings the present study fail support 
this hypothesis; none the informational 
conditions exhibited rate improvement 
any slower than that the continuous 
condition. One could account for this result 
introducing the notion “performance 
ceiling”, i.e. the continuous informational 
condition permitted such high initial level 
performance that there was little room for 
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can concluded, rather confidently, that 
there was reduction the tracking error 
the number categories error information 
was increased. Tracking error valid and 
widely used measure performance for many 
practical situations. 


Control Motion (CM) 


will recalled that the subject’s control 
system was such that displacements the 


motion 


Control 
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(b) the magnitude the thrust propor- 
tional the extent the displacement 
the control lever, and (c) the vehicle being 
guided will tend move the direction 
the displacement the control lever from the 
center position. such situation, the effect 
displacements the control lever the 
deviation from the desired course approxi- 
mated double integration the lever 
displacement. 


3 categories 
e—e 7 categories 
x-=--x 13 categories 
Continuous 


\ 


24hr rest period 


Trials 


Control motion the task function practice. Performance each the four informa- 
tional conditions shown separately. Each point the mean control motion score for the eight 


that performed under that condition. 


control lever were integrated twice before 
affecting tracking error, i.e. acceleration 
control was used. One the main purposes 
for this was provide task that would sim- 
ulate the general type controller situation 
with which man may confronted space 
travel attempting track manually some 
desired course single dimension. as- 
sumed that (a) there are only two outlets 
means which opposing thrusts, aligned 
may delivered for guidance purposes, 


Each time the control lever displaced from 
the center position, thrust delivered which 
requires the expenditure energy which 
assumed stored the vehicle. factor 
that presumably interest the designer 
such reaction-controlled systems the 
amount fuel (or energy) consumed the 
performance the controlling task. view 
the reduced tracking error which as- 
sociated with increases the number error 
categories, would considerable interest 
determine the relationship between the 
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guidance energy expended and the number 
error categories. should emphasized that 
the expenditure energy concern that 
which made available the equipment, and 
not the human operator. the amount 
energy expended directly related the 
number error categories, then trade-off 
between tracking error and guidance energy 
could made. The Score provides 
index this rate energy expenditure. The 


Control motion 
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least control motion. This interaction between 
task difficulty and informational condition 
should noted that the Scores are not 
monotonically related the precision in- 
formation, nor, indeed was the writer able 
develop any rationale that would adequately 
account for the obtained relationships among 
the Scores, the informational conditions, 
and task difficulty. There some evidence 


categories 
e—e 7 categories 
x---* 13 categories 


rest period 


16 


Trials 


Fig. Control motion the task function practice. Performance each the four 
Informational conditions shown separately. Each point the mean control motion score for the 
eight subjects that performed under that condition. 


mean the Scores for each trial under 
each the eight experimental conditions was 
computed. These average values are presented 
Fig. for the “easy” task and Fig. for 
the task. 

Inspection the curves average control 
motion reveal that, for the task (Fig. 6), 
the continuous informational condition resulted 
Scores that were consistently less than 
the others, while for the task (Fig.7), 
the three-category condition resulted the 


indicate that the low amount control motion 
under the three-category condition for the 
the part subject, i.e. the task was 
difficult that the subject effectively “gave up”. 

Generally, the Scores seem decrease 
the subject given more practice. The 
statistical analysis resulted significance for 
supporting this observation. Further, the 
Scores decreased more result practice 
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the task than they did the difficult” 
task (difficulty-by-trials, 0.05; difficulty-by- 
sessions, 0.05). 

also appears that there was differential 
reduction the Scores with practice 
depending upon the informational condition 
(Fig. 6), with the greatest rate reduction 
being associated with the continuous condi- 
tion. However, this notion was not supported 
the statistical analysis; neither the informa- 
tion-by-trials interaction nor the information- 
by-sessions interaction was significant. 


CONCLUSIONS 


The purpose this investigation was 
provide knowledge concerning the relationship 
between human performance and the precision 
feedback information. 

Four degrees feedback specificity and two 
levels task difficulty were studied terms 
their effect error and control motion 
the performance one-dimensional com- 
pensatory tracking task using acceleration 
control. given subject performed with 
continuous error information. The “easy” 
task consisted combination 14, and 
cpm sine waves and the “difficult” task was 
composed and cpm sine waves. 

Eight subjects were assigned randomly 
each the eight combinations feedback 
specificity and task difficulty. Each subject 
performed thirty 90-sec trials under his as- 
signed condition with 45-sec rest periods given 
between all trials except that 4-min rest was 
given midway each the two sessions; 
elapsed between sessions. 
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For tracking error, (a) performance improved 
monotonically, but decreasing amounts, 
the number categories information was 
increased, (b) this improvement was relatively 
unaffected the difficulty the task, and (c) 
the inhibitory effects the first session were 
greater for the less specific informational con- 
ditions, i.e. the 3-category condition, than was 
for the most specific informational condition, 
i.e. the continuous condition. The failure 
find optimal degree specificity informa- 
tional feedback was attributed largely the 
fact that the task was relatively complex. 
terms control motion score, which was 
approximation the energy expended the 
total system perform the controlling task, 
was found that (a) the effects specificity 
feedback information depended 
difficulty the task, (b) the scores generally 
decreased with practice, and (c) practice 
proceeded, the scores decreased relatively more 
the “easy” task than they did the 
task. 
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Development Design Criteria for 
Intelligence Display Formats, 


Memorial Institute, Columbus, Ohio. 


broad research program develop design criteria for intelligence display formats 
outlined and the general findings the program are discussed. Five specific areas 
investigation are selected for study: comparison vertical and horizontal 
arrangements alpha-numeric evaluation formats for trend displays, 
evaluation methods for presentation graphic multiple trends, evaluation 
five abstract coding methods, and evaluation the effect selected combina- 
tions target and background coding map reading performance. The five 


succeeding articles treat the five areas investigation detail. 


INTRODUCTION 


the design visual displays used 
intelligence center, the design engineer 
needs answers number questions con- 
cerning human-factors problems. 
stance, what types formats should used 
for the various displays What types coding 
methods should employed? the use 
color What the best method for 
displaying trends, historical data? The 
purpose this research program was 
attempt provide answers questions such 
these. The present paper provides intro- 
ductory and summary information describing 
the research program. The five following 


This work was sponsored the U.S. Air Force 
under Contract 30(602)-2078 (ref. RADC-TR-60- 


201). 
Reconnaissance 
Information 


INPUT. 

CENTER Information 
CONTROL Processing 

OUTPUT 


Information 


papers describe details the various experi- 
ments. 

The function the intelligence system under 
study collect, process, display, and report 
pertinent military information about the enemy 
(or potential enemy). The aspect this system 
with which the Battelle research program was 
primarily concerned utilization displays 
“Center Control” personnel who exercise 
management over the data-processing activi- 
ties. Broadly considered, Center Control exer- 
filtering function with respect direct- 
the processing system inputs and 
evaluating the quality system outputs. 
important requirement for visual displays 
anticipated connection with this function. 
Fig. general representation the system 
under study. 


Reconnaissance 


Extraction Interpreter 


Fig. General description system under study. 


ar 
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DISCUSSION PROBLEM 

provide for greater generality results 
and minimize the possibility overlooking 
important parameters, the Battelle research 
program was developed within systems 
framework. 

The performance system managers and 
analysts, measured terms both speed 
and accuracy, represents the criterion system 
performance optimized the present 
research program. For the system under study, 
apparent that this kind performance 
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These categories variables are illustrated 
Fig. which distinction made be- 
tween those categories variables that are 
under the control the system designer and 
those categories that are not. Within the 
limits electronic equipment, the system 
designer has control over methods presenta- 
tion. The system designer might also have 
control over operator characteristics, far 
might specify the types characteristics, 
such good visual acuity, high intelligence, 
etc., necessary for satisfactory performance 


Not Under Control of System Designer 


Type 
| information | 
displayed 
Problem Operator | | Methods of Operator 
situation | tasks Z | presentation performance | 
Operator | 
characteristics 
Environmental 
| a factors | 


Under Control of System Designer 


Fig. Variables that affect operator performance. 


function variety variables. The cate- 
gories variables believed most impor- 
tant are represented the following general 
equation: 

where 

performance 

=Complexity information 

=Operator tasks 

=Operator characteristics 

factors 


the system. Moreover, controls the environ- 
mental factors specifying the illumination 
level the operations room, distance between 
consoles, etc. 

the other hand, the system designer has 
little control over the type information 
displayed and the operator tasks per- 
formed, both which are essentially deter- 
mined the particular problem situation that 
presented. 

The first major step the present research 
program was select for study important 
variables pertaining methods presenta- 
tion. Almost important, however, were the 
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decisions concerning which the other cate- 
gories variables include the experiments 
and which exclude. Decisions concerning 
these secondary categories variables were 
follows: 

Type information displayed. 
attempt would made evaluate the 
effects various types information 
operator performance. For the informa- 
tion categories used the experi- 
ments, however, efforts would made 
develop items expected found the 
system under study. 

Density and complexity information. 
Because the likelihood significant 
interactions between display conditions 
and density-complexity data was de- 
cided vary both density and com- 
plexity data that the degree 
interaction between these variables and 
display conditions could ascertained. 

Operator tasks. Because the likelihood 
significant interactions between display 
conditions and operator tasks, was 
decided select representative tasks and, 
further, vary them that the degree 
interaction between tasks and display 
conditions could ascertained. 

Operator characteristics. attempt 
would made determine the relation 
between operator characteristics and per- 
formance. Subjects selected for the 
experiments, however, should fairly 
representative the population intelli- 
gence specialists assigned the system 
under study. 

Environmental factors. effort would 
made optimize major environmental 
conditions and, far possible, 
hold these conditions constant throughout 
the experiment. (Moreover, the size 
the displays would optimized and then 
held constant.) 

The objective the battelle research pro- 
gram was develop design criteria for intelli- 
gence display formats. Three types visual 
displays were investigated: 
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Alpha numeric. 
Trend. 
Cartographic. 


FORMULATION AND SELECTION 
RESEARCH PROBLEMS 
After acceptable conceptual framework 
for the system had been developed, the next 
step the research program was select 


TABLE 
Problem Areas for Alpha-Numeric Displays 
Display 
parameters Variables consider 
(a) Format: (1) Arrangement 
gories 
(2) Use color 
(3) Black white versus 
white black 
(4) Size display 
(5) 
ing ratio 
(b) Density: (1) Number categories 
(2) Total number letters 
and numbers 
(3) Amount data per unit 
area 
(4) “Word” size 
(c) Number Data are given for how 


Categories: many categories 
(d) Coding (1) Descriptive phrases ver- 
Dimensions: sus symbols for cate- 
gories 
(2) What coding system for 
symbols 


(3) Families symbols 

(4) Multidimensional 
ing 

(5) Use colored symbols 

(6) Association character- 


istics 
(e) Rate (1) Change categories 
Change: (2) Change all data for 
categories 


(3) Change particular 
data for categories 


(a) 


sus 


10W 


specific problems for investigation. Problem 
areas were formulated considering display 
parameters relation each the three types 
displays. The results this formulation are 
presented Tables II, and III. 

investigated, three primary criteria were 


established: 


(1) Importance problem. 
(2) Applicability results. 
(3) Feasibility conducting study. 


TABLE 


Problem Areas for Trend Displays 


Display parameters 
(a) Format: 


(b) Density: 


(c) Number 
Categories: 


(d) Coding 
Dimensions: 


(e) Rate 
Change: 


Variables consider 

(1) Line graph versus bar 
graph 

(2) Arrangement 
gories 

(3) Number trends 

(4) Black white versus 
white black 

(5) Size displays 

(6) Ambient/display 
ing ratio 

(1) Number trend figures 

(2) Amount each figure 


(1) Number graphs 
(2) Number different 
lines graph 


(1) What symbols are used 

(2) How are symbols or- 
ganized 

(3) Multidimensional cod- 
ing 

(4) Use color coding 

(5) Association character- 
istics 

(1) Number time inter- 
vals 

(2) Change present time 
condition 

(3) Rate change new 
parameter 
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TABLE 


Problem Areas for Cartographic Displays 


Display parameters 
(a) Format: 


(b) Density: 


(c) Number 
Categories: 


(d) Coding 


Dimensions: 


(e) Rate 
Change: 


Variables consider 

(1) Degree pictorial 
reality 

(2) Area covered 

(3) Use texture 

(4) Use color 

(5) Use elevation 

(6) Mosaic single map 

(7) Black white versus 
white black 

(8) Size display 

(9) 
ing ratio 

(10) Scale 

(1) Amount detail 
geographic nature 

(2) Number names 
etc. 

(3) Number symbols 


(1) Types information 

(2) How many types 
symbols 

(1) How are categories 
coded 

(2) Use colored symbols 

(3) What dimensions (e.g. 
size, shape) for each in- 
formation category 

(4) Families symbols 

(5) Degree reality 
code-association 
acteristics 


(1) Number different 
maps per unit time 

(2) Rate updating sym- 
bols maps 


applying these three criteria for problem 
selection the problem areas specified 
Tables and five specific problems were 
selected for investigation. The five resulting 


studies were: 


(1) comparison vertical and horizontal 
arrangements alpha-numeric material. 
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(2) evaluation formats for trend 
displays. 

(3) evaluation methods for presenta- 
tion graphic multiple trends. 

(4) evaluation five different abstract 
coding methods. 

(5) evaluation the effect selected 
combinations target and background 
coding map-reading performance. 


EXPERIMENTAL RATIONALE 


mentioned previously, the primary objec- 
tive the research program was develop 
design criteria for intelligence display formats. 
This means, course, that the experimental 
results should formulated such manner 
useful the design engineer. 

The major factor that reduces the experi- 
mentalist’s confidence generalizing the 
operational setting the obvious gap between 
the research laboratory and the “real 
alleviate this problem, the present research 
program was designed partial simulation 
the actual operational setting. For example, 
the major experimental conditions, the secon- 
dary variables, the subjects, and the operator 
tasks were all believed fairly representa- 
tive what might found the present 
system. attempt was made, however, 
simulate exactly the conditions found the 
actual system. 

The present research program thus falls 
somewhere between fundamental laboratory 
research one extreme and operational field 
testing the other. Such approach permits 
the design well-controlled experiments 
which the variables under study may varied 
systematic manner; furthermore, the intro- 
duction certain amount realism permits 
greater degree generalization. The de- 
velopment research program this level 
the “degree-of-reality continuum” means 
essentially this: concluded that one 
experimental condition superior second 
condition, then assumed that this same 
order conditions will prevail the actual 
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operational system. Because the actual system 
was not completely simulated, however, 
not have much confidence that the magnitude 
the differences between experimental condi- 
tions will hold the actual system. 


Experimental Apparatus 


Two display units were constructed for rear- 
projection presentation 35-mm slides. The 
projectors were fully automatic with respect 
slide changing; tray cardboard- 
mounted 35-mm slides could shown indivi- 
dually simply pressing changing switch 


Fig. display unit. 


each new slide was desired. The long 
axis 35-mm slide projected was in. 

display unit consisted enclosed hous- 
ing built frame lumber. The 
frame was long, in. wide, and in. 
high. Legs the corners and each side 
the center were mounted casters, which 
permitted easy movement the unit. Includ- 
ing the casters, the overall height the frame 
was in. sheet plywood covered 
the top the frame. 

framed piece }-in. glass 
was mounted vertical position 
in. from the front the frame. area 


Lenscreen high-quality display screen produc- 
process coating plate glass with thin layer 
microscopically small lenses. 
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behind the screen was enclosed with 
plywood. The inside the enclosed area 
was painted flat black. small, circular hole 
the rear the enclosed area permitted pro- 
jection the center and rear the Lenscreen. 
small wooden stand the outside rear 
the enclosed area, and mounted top the 
frame, held the projector. display unit 
shown Fig. 

The response-timing and stimulus-presenta- 
tion devices consisted two control boxes, 


Fig. Rear display unit showing projector and 
experimenter’s control box for response- 
timing and stimulus-presentation device. 


one for the subject’s use and the other for the 
experimenter’s use. The subject’s control box 
contained push-button which could start and 
stop the timer, well introduce and remove 
slide. The experimenter’s control box con- 
tained time meter that recorded time with 
second accuracy and push-button for 
signaling the subject. The rear display 
unit showing the projector and the experi- 
menter’s control box for the response-timing 
and stimulus-presentation device shown 
Fig. 

Regular classroom desk seats were used 
that subjects sitting front the display unit 
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would have convenient writing space for paper- 
and-pencil tests. The subject control boxes for 
the response-timing and stimulus-presentation 
devices were mounted the front center, and 
flush with the desk each subject’s seat. 

all the experiments that employed slides 
for stimulus material, the above display units 
were used. two the experiments, how- 
ever, cardboard posters rather than siides were 
used for stimulus material. The experimental 
room for these two studies contained wooden 
stand with window blind for the posters and 
desk-type chair for the subjects. The illumin- 
ation was approximately ft.-c. the 
screen the wooden and the order 


Selection Subjects 


The population people expected 
represented the experimental subjects 
indeed general population, with few specified 
characteristics. probably can assumed, 
however, that the intelligence specialists work- 
ing with displays the system 
under study: (1) are male, (2) are college 
caliber intelligence and technical compe- 
tence, and (3) possess normal vision. 

Thus, meet these general criteria, male 
Battelle technicians and engineers were asked 
serve subjects the experiments. The 
Snellen Chart and the H-R-R Pseudoiso- 
chromatic Plates were used test the subjects 
for visual acuity and for color vision, respec- 
tively. 


GENERAL DISCUSSION AND 
CONCLUSIONS 


The present research program has added 
further support the value multivariable 
experiments. The overall efficiency such 
experiments terms amount information 
obtained per unit cost indeed sufficiently 
great offset any difficulties associated with 
such approach. Even more important, 
however, that multivariable exreriments 
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permit the investigation interactions between 
(and among) variables. apparent that 
design recommendations based only main 
effects can misleading. most the ex- 
periments, follow, the results are quali- 
fied the various interactions. Naturally, 
they have little practical 
though they are statistically significant—then 
the designer need not burdened with such 
findings. When such interactions are impor- 
tant practical sense, however, essential 
that recommendations qualified accord- 
ance with these findings. 

second general conclusion concerns the 
study operator tasks. First, important 
note that significant interactions were found 
between display conditions and operator tasks. 
Second, equally important note that 
independent, orthogonal, task factors were 
obtained from the statistical analysis. Inas- 
much task tests—rather than task items— 
were intercorrelated, the resulting factors were 
not “clean” might desired. Never- 
theless, the statistical results permitted mean- 
ingful the factors. the 
basis these findings, seems that many the 
future studies the design visual displays 
would benefit operator task were included 
one the experimental variables. Further- 
more, because task factors interact with display 
parameters, important determine soon 
possible whether not these task factors 
are representative the real-world data- 
processing operations under study. would 
then possible make recommendations 
concerning display parameters according the 
relative importance the various tasks. 
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review the literature emphasizes the 
need for more standardized (as well more 
appropriate) conditions for the study visual 
displays. relatively easy task find 
studies visual displays that report contra- 
dictory results. reviewing these studies 
detail, however, might found that they 
differed in: subject tasks, actual specification 
experimental conditions, experimental proce- 
dures, and environmental conditions, well 
characteristics subjects. greater stan- 
dardization could achieved with respect 
the important parameters visual-display 
experiments, then certain that more 
consistent and more meaningful reports would 
forthcoming. 

assist the individuals responsible for the 
design visual displays, extremely worth- 
while goal would develop detailed, 
up-to-date handbook Criteria for 
Visual Displays”, which might serve 
II” the handbook developed 
Baker and Much information 
already available for such handbook, but 
scattered throughout the many Government 
reports, technical journal articles, 
books. such information were collected and 
integrated, however, would serve 
excellent foundation for visual-display hand- 
book, well give direction future work 
visual displays. 
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Comparison Vertical and Horizontal 
Arrangements Alpha-Numeric 


Material—Experiment 


JOHN COFFEY, Battelle Memorial Institute, Columbus, Ohio. 


The objective this study was determine the relative effectiveness visual displays 
containing alpha-numeric material displayed vertical and horizontal arrange- 


ments. Variables included the experimental design were: types arrangement 
display material, density material, composition material, and operator 
tasks. The major finding the study was the non-significance the arrangement 
variable. was found that, for all practical purposes, the differential effects 
vertical and horizontal arrangement alpha-numeric materials operator 


INTRODUCTION 


The use alpha-numeric materials visual 
displays common practice. These displays, 
commonly known status boards, may stand 
alone they may used complement other 
types displays. 

The arrangement the data the display 
one the basic considerations the con- 
struction alpha-numeric display. there 
optimum «vay arranging these data 
according the type material used, the 
amount material used, and the task 
required the operator, then the display 
should designed maximize the speed and 
accuracy with which the material can used. 

The objective this study was determine 
the relative effectiveness visual displays 
containing alpha-numeric material displayed 
vertical and horizontal arrangements. The 
relative effectiveness these two arrangements 
was evaluated, with variations the density 
the material the display, the types 
alpha-numeric material, and the subject tasks. 


METHOD 


Experimental Design 

The experimental design for the study was 
complete factorial with subjects 
per cell. Two replications the study were 
conducted. The variables the design were: 


This work was sponsored the U.S. Air Force 
under Contract 30(602)-2078 (ref. RADC-TR-60- 
201). 


performance are negligible. 


(1) two types arrangement—horizontal and 
vertical; (2) two density levels—one column 


row and three columns rows; (3) four 
compositions 
letters, numbers, letters and numbers combined, 
and two-letter words; and (4) four subject tasks 
—counting, locating, identifying, and compar- 
ing. 

Each subject was tested under each the 
experimental conditions each the two 
replications. The same subjects were used 
both replications. 


Subjects 


The subjects for this study were selected 
from the pool subjects referred previously. 
All subjects were male, with age range 
33. The educational range was from high- 
school graduates with some university under- 
graduate work university graduates with 
varying amounts graduate work. 


Display Material 

Sixteen original formats were prepared. 
Four these formats contained only letters 
different arrangements and density; four for- 
mats contained only numbers different 
arrangements and density; four formats con- 
tained only letters and numbers combined 
different arrangements and density; and four 
formats contained only two-letter words 
different arrangements and density. 

Letter formats. four formats containing 
only letters were constructed the following 
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manner. The first format consisted one row 
letters. The letters were determined 
random sampling with replacement from the 
alphabet letters (i.e. all letters with the 
exception “O”). The second format con- 
taining only letters was made one column 
letters. The third format containing only 
letters was made three rows letters 
each. The fourth, and last, format this group 
was made columns letters each. 
all cases, the sampling was random with 
replacement. 

Number formats. The four formats containing 
only numbers were constructed exactly the 
same manner those containing only letters. 
The construction these four formats resulted 
one format containing one row ran- 
domly selected numbers, one format containing 
one column randomly selected numbers, 
one format containing three rows ran- 
domly selected numbers each, and one format 
containing three columns randomly 
selected numbers each (zero was omitted). 

Letter and number formats. The four formats 
containing letters and numbers combined were 
constructed essentially the same manner 
those for letters alone. every case, however, 
each row column contained numbers and 
letters. The assignment the position 
the row column occupied letter 
number was completely randomized. This 
procedure resulted one format containing 
one row randomly selected letters and 
numbers, one format containing one column 
randomly selected letters and numbers, one 
format containing three rows each with 
randomly selected letters and numbers, and 
one format containing three columns each with 
randomly selected letters and numbers. 

Two-letter word formats. The four formats 
containing two-letter words were constructed 
from population commonly used words. 
The formats were constructed random 
manner, such was done for letters alone 
numbers alone. The only difference was that 
each column row contained only two- 
letter words rather than the entries pre- 
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viously used. The construction procedure 
resulted one format containing one row 
randomly selected two-letter words, one 
format containing one column randomly 
selected two-letter words, one format contain- 
ing three rows each with randomly selected 
two-letter words, and format containing three 
columns each with randomly selected two- 
letter words. 

The formats constructed outlined 
above were used for the entire study. These 
formats contained the variable horizontal 
arrangement and vertical arrangement corres- 
ponding rows and columns, the variable 
density represented one row column and 
three rows columns, and the variable 
composition alpha-numeric material repre- 
sented letters alone, numbers alone, 
and numbers combined, and two-letter words. 


Test Material 


The fourth variable the study, outlined 
the Experimental Design section, was subject 
tasks. The four tasks employed were counting, 
locating, identifying, and comparing. For each 
display format group four questions was 
constructed for each task. The resulting 256 
questions were used throughout the study. 


Preparation Experimental Material 


The experimental material was prepared 
combining appropriate stimulus test 
material. order for each the tasks 
paired with each display format, the formats 
were photographed four times each, resulting 
total slides. Thus, one replication 
all subjects viewed each the original 
formats four different times, with different 
task perform each time. 

slide paired with set four questions 
one type, i.e. count, locate, identify, com- 
pare, constituted one experimental condition. 
The study was made such experimental 
conditions. Twenty-four rando.n sequences 
the experimental conditions prepared; 
the only restriction placed these se- 
quences was that the same could not 
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appear twice succession. Twelve these 
sequences were drawn random, and the 
subjects were assigned random these 
sequences. For the second replication the 
experiment, the subjects were again assigned 
random the remaining sequences. 

For each sequence, test booklet containing 
consecutively numbered pages was prepared. 
Each page contained four questions one 
particular type. 

The slides were also arranged ran- 
domized sequence correspond exactly the 
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Sample display containing one row letters 


OF DO BY 
DO TO BE 
BY AN AN 
BE IN DO 
IN DO IF 
IF IT GO 
AT IT DO 
ON AT IN 
IT BE TO 
1S GO ON 
ON BY OR 
IT OR IT 
ON OF TO 
AS AT BY 
OF OR 
iS GE tT 


Sample display containing three columns of two-letter words 


arrangement test-booklet pages. This pro- 
cedure was maintained for all subjects both 
replications the study. Two sample displays 
and four sample questions each type relating 
one the displays are included Fig. 
and Table respectively. 

permit subject practice and minimize 
learning effects, two additional formats were 
constructed the previously outlined manner 
for use training displays. One format con- 
tained one randomly selected letters, 
and the other “ormat contained three columns 
each randomly selected two- 
letter word: each sample format set 
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TABLE 


Sample Questions for Sample Display Containing one 
Row Letters 


Counting Questions 
How many times does 
How many times does 
How many times does 
How many times does 


Locating Questions 
there least one anywhere the 
right 
there least one anywhere the 
left 


Identifying Questions 
the eighteenth entry from the left 
the seventh entry from the left 
the twenty-fourth entry from the right 
aC? 
the twelfth entry from the right 


Comparing 

the row were divided the center, 
would appear both halves 

the row were divided the center, 
would appear both halves 

the row were divided the center, 
would appear both halves 

the row were divided the center, 
would appear both halves 


four questions was developed for each the 
four operator tasks. The sample formats were 
photographed four times allow pairing 
each set questions with each format. This 
procedure resulted eight slides with 
questions for the training period. 


Experimental Procedure 

Four experimental sessions were arranged. 
The first session included the training period 
and the first experimental conditions. The 
second session consisted the final condi- 
tions the first replication. The third and 

The subject’s desk chair was placed 
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front the screen. All projected alpha- 
numeric characters were approximately in. 
height. The center the projected display 
was in. from the floor. 

During the first part experimental 
session, the subject was read standard set 
instructions. was told that the purpose 
the study was determine the speed and 
accuracy with which could handle alpha- 


Source variance 
Subjects (S) 
Arrangements (A) 
Density levels (D) 
Composition alpha- 

numeric material (C) 
Tasks (T) 
SAD 
SAC 
SAT 
SDC 
SCT 
ADC 
ADT 
ACT 
DCT 
SADC 
SADT 
SACT 
SDCT 
ADCT 
SADCT 
Residual 


TABLE 


Summary Analysis Variance 
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numeric material. was 
speed and accuracy were equally important. 
After all questions had been answered, the 
subject was given his appropriate test booklets, 
and after signal commence, the subject 
proceeded self-paced manner complete 
the first experimental session. 

The second, third, and fourth experimental 
sessions were conducted the same manner 


Mean square Error term 
2.1500 Residual 153.57* 
0.0000 0.00 

11.2709 383.36* 
0.1958 11.00* 
1.0570 12.42* 
0.0251 Residual 1.79 
0.0294 Residual 2.10* 
0.0178 Residual 1.27 
0.0851 Residual 6.08* 
0.0897 SAD 6.45* 
0.0806 SAC 
0.2455 SAT 23.38* 
0.0321 SDC 3.49* 
1.6769 SDT 145.82* 
0.0404 SCT 
0.0139 Residual 0.99 
0.0177 Residual 1.26 
0.0105 Residual 0.75 
0.0092 Residual 0.66 
0.0157 Residual 0.82 
0.1331 SADC 11.18* 
0.0331 SADT 2.36 
0.0277 SACT 2.50* 
0.0291 
0.0119 Residual 0.85 
0.0140 Residual 1.00 
0.0111 Residual 0.79 
0.0122 Residual 0.87 
0.0240 SADCT 1.68 
0.0143 Residual 1.02 
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the first, with the exception that training 
was eliminated. 


RESULTS 

give weight both speed and accuracy 
response, the time scores and the accuracy scores 
were combined into correct-items-per-minute 
scores. time score for each page four 
questions was recorded during the experiment. 
The number correct answers the page 
was divided the time score for the page 
obtain correct-items-per-minute score. The 
correlation computed between mean subject 
response times and correct 
responses over all experimental conditions was 

correlation 0.93 was found between the 
two replications the study. This correlation 
was based upon mean subject performance for 
the two replications over the experimental 
conditions. 

order more nearly meet the assump- 
tions variance and normality 
distribution for analysis variance, the 
correct-items-per-minute scores were con- 
verted logarithmic scores. With the assump- 
tion mixed model, the 1536 transformed 
scores were analyzed analysis variance 
techniques. The main effects density levels, 
composition alpha-numeric material, and 
subject tasks were significant the per cent 
level confidence, while the main effect 
arrangement was not. The results the 
analysis are presented Table II. 

The significant main effects and two-factor 
and three-factor interactions from the analysis 
variance were analyzed means the 
Duncan multiple range test. All these 
analyses were conducted the means the 
logarithmic correct-items-per-minute scores. 

The main effect arrangements considered 
independently was not significant. The geome- 
tric mean (i.e. the antilog the log mean) 
the scores for horizontal arrangement was 6.34 
correct responses per minute, and for the 
vertical arrangement was also 6.34 correct 
per minute. 
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The main effect density levels was statisti- 
cally significant. might expected, per- 
formance was superior the lower density 
level one column row alpha-numeric 
material compared with the higher density 
level three columns rows. The geometric 
mean the scores for the lower density leve! 
was 7.72 correct responses per minute, and for 
the higher density level was 5.20. 

The main effect composition alpha- 
numeric material was also significant. The use 
two-letter words resulted better perform- 
ance than the use letters alone, numbers 
alone, and letters and numbers combined. 
Moreover, the main effect subject tasks was 
significant. The tasks locating and compar- 
ing were accomplished significantly better 
than either the counting identifying tasks. 

The results for all main effects are summar- 
ized Table 

indicated from the analysis variance, 
number the interactions were statistically 
significant the per cent level confidence. 


TABLE 
Subject Performance for Each the Main Effects 


(a) Arrangement 


Vertical Horizontal 
6.34 6.34 
(b) Density 
Three rows One row 
columns column 
5.20 


Composition Material 


Numbers Letters and numbers 


6.11 6.13 6.30 6.84 
(d) Subject tasks 
Count Identify Locate Compare 
5.72 5.73 6.75 7.29 
Notes: 


(1) Scores reported terms geometric mean 
correct responses per minute. 

(2) Experimental conditions connected line are 


57* 
42* 
1.27 
45* 
.38* 
.82* 
.26 
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The magnitude these interactions, however, 
was not sufficiently large indicate that they 
would have any meaning the practical situa- 
tion. Hence, the interactions will presented 
greater detail than shown Table II. 


DISCUSSION AND CONCLUSIONS 


This study was designed compare vertical 
presentation with horizontal presentation 
alpha-numeric material under variety 
conditions. The conclusions are naturally 
limited the types and variations the 
variables included, the measures perform- 
ance employed the study, and the popula- 
tion subjects represented those partici- 
pating the study. 

was found that subjects performed better 
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with words than with other types alpha- 
numeric materials. This probably can 
attributed the greater meaningfulness 
words. would expected, the higher 
density condition degraded subject perform- 
ance. With regard subject tasks, locating 
and comparing resulted significantly better 
performance scores than did counting and 
identifying. 

The major finding the study was the non- 
According the results the present study, 
the design engineer can assume that, for all 
practical purposes, the differential effects 
horizontal and vertical arrangement alpha- 
numeric material operator performance are 


negligible. 
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Evaluation Formats for 
Graphic Trend 


HOWARD SCHUTZ, Battelle Memorial Institute, Columbus, Ohio. 


This study was designed determine which three types trend formats results 
superior performance for task requiring the subject make complex decisions. 
Three commonly used formats were included the study: line type, vertical-bar 
type, and horizontal-bar type. Two secondary independent variables were: number 
time points and amount missing data. Results the study indicate that 
preference should given line-type graphs, followed closely the vertical-bar 
type. secondary finding was that irrelevant points and missing data graphic 
trend displays represent important factors the degradation operator perfor- 


mance. 


INTRODUCTION 


The display trends usually shown 
graph which the horizontal axis represents 
one variable and the vertical axis second 
variable. This especially common when one 
variable time and the second some para- 
meter which will vary some manner over 
time. There are many applications for such 
trend graphs intelligence systems, because 
the data collected such systems often repre- 
sent values for some parameter various 
points time. 

One possible advantage the graphic trend 
display over the alpha-numeric type for dis- 
playing time-correlated data its superiority 
for prediction. Since rate change can 
estimated from the slope line, possible 
extrapolation estimate when variable 
will reach some predetermined critical value. 
Alpha-numeric displays not facilitate this 
type extrapolation. Another advantage 
graphic trend displays that two more 
trends may readily compared. For instance, 
the task might determine which two 
trends increasing faster rate. This also 
would more difficult task with alpha- 
numeric display. 

the design graphic trend display, one 
the first decisions the designer must make 
concerns the type format used. Format 
used with trend displays defined the 


This work was sponsored the U.S. Air Force 
Contract AF30 (ref. RADC-TR-60- 
01). 


manner which the data are represented. 
Three the most common formats are: (1) the 
line type which connects data points 
single continuous line; (2) the vertical-bar type 
which uses vertical lines varying heights; 
and (3) the horizontal-bar type which uses 
horizontal lines varying length. Although 
for some applications one type format may 
preferred over the others, the choice 
often difficult. Furthermore, the necessary 
guidelines are not available the literature. 
The present study was designed yield 
information aid design engineers selecting 
the type format for trend displays. Two 
secondary independent variables were included 
this study: number time points and 
amount missing data. These two variables, 
which will described more detail the 
next section, were included allow greater 
generality the format results, well 
determine their effect operator performance. 


METHOD 
Experimental Design 
The design was 3x3x3x10 complete 
factorial with two replications. The first 
variable was format, which had three qualitative 
levels: line, column, and bar. The second 


variable was number points, which had 
three levels: 12, and points. The third 
variable was amount missing data, and this 
also had three levels: none, one-sixth, and 
one-third missing. The fourth variable was 
ten randomly selected subjects. This design 
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Time 
12 point 


Time 
18 point 

Line format for 6-, 12-, and 18-point graphs. 


Number 


Time 
6 point 


Number 


Fig. Vertical-bar format for 6-, 12-, and 18-point 
graphs. 
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yielded twenty-seven fixed experimental condi- 
tions which, when repeated twice for each 
subject, resulted two replications. Fig. 
and show example the three formats 
with 12, and points and missing 

The task the subjects using these dis- 
plays involved the manipulation arbitrary 
rules arrive probabilities. Although 
somewhat artificial, hopefully, this kind task 
may generalized the problem-solving 


Time 


Time 


Time 


12 point 18 point 


Fig. format for 6-, 12-, and 18-point 
graphs. 


behavior analysts. Since one the basic 
kinds decisions made about graph 
whether the trend level going upward, 
downward, remaining essentially the same, 
this type decision was selected the founda- 
tion for the operator tasks. 

reduce the effects individual differ- 
ences the interpretation trends, set 
specific decision rules was taught each 


Stimulus figures are reshown from print 
the original slide material and are reasonable 
facsimiles rather than exact 


Number 


Number 


Number 


t.2 34 
Time P 
6 point 
6 
2 
26 | 
5 
12 
9 9 
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subject prior experimentation. These rules 
correspond the data displayed the graphs. 
Six points were chosen the basic set points 
about which the subject would required 
make decisions. Ten variations these six 
points were developed along with corres- 
ponding direction and probability trend 
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and their corresponding graphic representation 

for the line-type format with six points are 

shown Fig. The four general rules given 
the subject were follows: 

(1) Points the graph can differ only 

0.50 scale value the number scale 

from the point preceding following it. 


4 

123456 


Time Time 
0-50 up 0-20 no trend 
Two contiguous sets Any other combination 


three increasing points of points 
6 6 
3 
Time Time 
0-50 down 0-40 up 


When there one missing 
point in a trend the p-volue 
should reduced 0:10 


Two contiguous sets of 
three points 


Time Tirne 
0-50 no trend 0-30 up 
Two contiguous sets of When there are two missing 
three equal points points in a trend the p-value 
should be reduced by 0:20 


(c) (d) 


Twelve patterns and rules for naming trend and determining probability. 


Time Time 
0-90 up 0-75 up 
Six consecutive in- Four consecutive in- 
creasing points creasing points 
- 
Time Time 
0-90 down 0-75 down 
Six consecutive de- Four consecutive de- 
creasing points creasing points 
Time Time 
0:90 no trend 0:75 no trend 
Six consecutive equal Four consecutive equal 
points points 
(a) (b) 
values. The probability values represented 


estimates the degree confidence person 
might have that the ten types trends actually 
exist. addition, probabilities were modified 
the occurrence missing data the trends. 
This modification the probability was con- 
certainty, which would surely result there 
were missing data The twelve rules 


(2) When points are missing, they will 
interpolated form trend accord- 
ing the twelve specific learned rules 
and accordance with the first general 
rule. 

(3) Find the trend with the highest proba- 
bility occurrence. 

(4) There only one correct trend for each 


graph. 
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Certain conventions were followed com- 
bining the fixed variables. These conventions 
were developed create much realism 


Time 
QO. points missing 
6 


Time 
1/6 points missing 


Number 


1/3 points missing 


Fig. Examples 6-point graph with and 
missing data for line-type graph. 


graphic trend display possible, while still 
maintaining good experimental control over 
the various conditions. For the 6-, 12-, and 
18-point conditions, the basic set points 
was included unit. The location the 
points was selected random with the 
restriction that the points appear unit. 
The additional points were placed 
that they did not satisfy given rule. 
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Adjacent points were never more than 0.50 
scale points apart, either the basic set 
the additional points. For the one-sixth and 
one-third missing-data conditions, and 
and and and points were missing from 
the 6-, 12-, and 18-point conditions, respec- 
tively. the 12- and 18-point conditions, half 
the points were taken from the basic set and 
the other half random from the remaining 
points. Two consecutive points were never 
missing. Fig. and show example 
the line-type format for 6-, 12-, and 18-point 
graphs which have the same basic set 


Number 


5 
2 


Time 


Number 


1/3 points missing 


Examples 12-point graph with and 
missing data for line-type graph. 


Number 


Alumbher 


~ 


m 
4 
Time 
O points missing 
Time 
1/6 points missing 
4 
Time 
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points for the none missing, the one-sixth, and 
one-third missing point conditions. 

specific design was developed which 
each the twenty-seven treatments would 
tested equal number times under each 
the ten basic patterns points. addition, 
the order presentation was randomized 
minimize effects learning and fatigue. 


4 


te) 2345 678 9 Wll 1213 14 15 1617 18 
Time 
O points missing 


Number 
w 


Time 
1/6 points. missing 


Number 


0 12345 6 7 8 9 1011 12 13 14 15 16 17 18 
Time 
1/3 points missing 


missing data for line-type graph. 


general comment about the construction 
the three types formats order. Every 
attempt was made apply sound human- 
engineering principles each the formats. 
Size numbers, size letters, line spacing, 
and line width were selected create the best 
possible representation the three formats. 
Human-engineering guides and consultation 
with technical artists were utilized making 
such decisions. 


Subjects 


Ten male Battelle employees the profes- 
sional level were selected from the available 
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pool subjects. The professional level was 
considered appropriate since this type display 
would most likely used officers with 
considerable experience intelligence work. 


Materials 


The twenty-seven display conditions were 
drawn artists and photographed pro- 
duce positive 35-mm transparency. The pro- 
jection and response-timing equipment were 
the same described the first paper this 
series. The projected size the graphs 
naturally varied with the variables format 
and number points: 6-, 12-, and 18-point 
and in. in., respectively. 


Procedure 


All subjects were given general orientation 
the purpose the study and the procedures 
followed. They were then instructed 
memorize the set rules shown Fig. 
After subject had learned the list 100 per 
cent criterion, was given complete set 
twenty-seven treatments, during which time 
could ask questions clarify any uncertainty. 
This extensive practice session was considered 
necessary because the difficulty the tasks 
and the necessity associating the rules with 
the graphs. The subjects were instructed 
find the correct trend quickly possible. 
The testing procedure was self-paced. The 
subject would depress push-button present 
display the screen and start timer. 
depress the push-button again. This would 
remove the display and stop the timer. The 
subject would then state the direction and 
p-value associated with the trend. 

The subjects two different occasions 
received two other sets the twenty-seven 
experimental conditions. The procedures were 
the same the training session. The sub- 
jects were tested the twelve rules imme- 
diately before each replication check their 
mastery the material. Each test session 
required approximately min for completion. 
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The experimenter recorded both the time 
respond each display and the subject’s oral 
response for the direction and p-value the 
trend. Seating and lighting arrangements 
were identical those described the first 
paper this 

After the experiment was completed, each 
subject ranked the trend formats according 
the extent which preferred use the 
displays. 


RESULTS 
Treatment the Raw Data 


Means the time scores over ten subjects 
were computed for each the twenty-seven 
treatments and for both replications. The trend 
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and p-values were scored for accuracy accord- 
ing the following rules: 


response Score 
Wrong direction—wrong 
Right direction—wrong probability 
Right probability—wrong direction 
Right probability 


Means the accuracy scores over ten subjects 
were then computed for each the twenty- 
seven treatments and for each replication. 


Reliability 


The reliability both the time and accuracy 
scores were checked correlating the twenty- 
seven means for time and accuracy the first 


TABLE 


Summary Analysis Variance for Time Scores 


Source variance 
Subjects (S) 
Format (F) 
Number points (N) 
Missing data (M) 
Replication (R) 
SFN 
SFM 
SNM 
FNM 
SFR 
SNR 
SMR 
SFNM 
Residual 


0.05. 


Mean square Error term 
1.2162 Residual 44.55* 
0.6469 23.18* 
4.9481 213.12* 
3.5270 109.52* 
0.6112 8.64* 
0.0279 Residual 1.02 
0.0232 Residual 
0.0322 Residual 1.18 
0.0707 Residual 2.59* 
0.0357 SFN 1.05 
0.1082 SFM 3.79* 
0.0154 SFR 
0.0414 SNM 1.64 
0.0424 SNR 2.10 
0.0166 SMR 
0.0340 Residual 1.24 
0.0285 Residual 1.04 
0.0252 Residual 
0.0373 SFNM 1.25 
0.0384 Residual 1.41 
0.0202 Residual 
0.0323 Residual 1.18 
0.0297 Residual 1.09 


0.0273 
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TABLE 


Geometric Means for Significant Fixed Main Effects and Interactions for Time Scores 


Format Number of points Missing data Replication Format by missing data 
Vertical Horizontal Proportion Vertical Horizontal 
6.81 7.36 7.87 11.02 5.50 7.76 10.47 8.26 7.07 6.94 
10.34 


Notes: 


(1) All values not underlined the same line differ from one another 0.05. 


(2) Scores reported in seconds. 


replication with their respective means for the 
second replication. The for time was 0.93 
and the for accuracy was 0.75. 

The relation between time and accuracy was 
determined correlating the time and ac- 
curacy averaged over both replications. This 
correlation was —0.90, which indicates that, 
for all practical purposes, time and accuracy 
were reflecting the same pattern scores over 
the twenty-seven treatments. 


Time-Score Analysis 


The raw time scores were transformed 
logs order more nearly meet the assump- 
tions underlying analysis variance. 
addition, the logs would yield more valid 
measure central tendency, the geometric 
mean, than would arithmetic mean (because 
the characteristic positively skewed nature 
time scores). The transformed time scores 
were analyzed with modified five-way mixed 
model the analysis variance. Mean 
squares were computed for only the main 
effects and all two- and three-way interactions 
for the replication variable. These results are 
summarized Table 

All main effects were significant, and two 
the two-way interactions, subjects replica- 
tion and format missing data, were signifi- 
cant. Table gives the geometric means, for 
each the major effects. Duncan multiple 
range test! was conducted for each significant 
main-effect source determine which dif- 


Geometric means antilogs mean log scores. 


ferences between pairs means were signi- 
ficant. All the means for the main effects 
differed from one another 0.05. 

Table also includes the means for each 
format under all three missing-data conditions, 
since this interaction was statistically signifi- 
cant. The Duncan multiple range test was also 
applied these interaction means. Fig. 
graphically illustrates the interaction. 
apparent that the three formats not differ 
significantly from one another the one-third 
level missing data, whereas the other two 
levels missing data, the formats are signi- 
ficantly different. The significant subject 


O Vertical bor 
Horizontal bar 


Speed of Response, geometric means in seconds 


Amount of Missing Data 


Fig. Graphic illustration two-way interaction be- 


tween format and amount missing data. 
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replication interaction signifies that some sub- 
jects improved performance for the second 
replication and others did not. 


Accuracy-Scores Analysis 


The accuracy scores were not distributed 
manner meet the assumptions analysis 
variance. Because the restricted range 
scores, transformation scores would still not 
provide set scores which could correctly 
analyzed parametric analysis variance. 
Thus, because the accuracy scores did not lend 
themselves ordinary analysis-of-variance 
techniques, and, further, because the correla- 
tion (r= —0.90) between time and accuracy 
was high, the accuracy data were not exten- 
sively analyzed. 
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test for this analysis may attributed part 
the small number cases available for the 
analysis. Examination the means Table III 
indicates that the rank order the means 
about the same the time-score analysis. 
This similarity would expected the basis 
the high between time and accuracy data. 
might some additional value point out 
that most the errors occurred the missing- 
data conditions, evident examination 
the means Table III. 

The preference ranking data were averaged 
over the ten subjects. The mean ranks were 
follows: line, column, 1.9; and bar, 3.0, 
with representing the most preferred graph. 
This rank order the same that found for 
both the time and the accuracy scores. 


TABLE Ill 


Means Accuracy Scores for Main Variables and One Interaction 


Format* Number of points* 


Missing data* 


Replication Format by missing data 


Vertical Horizontal Proportion Vertical Horizontal 

Line bar bar 6 12 18 0 3 a 1 2 missing Line bar bar 
1.72¢ 1.64 1.50 1.78 1.60 1.48 1.86 1.67 1.33 1.61 1.92 1.95 1.70 
1.80 1.70 1.52 

1.28 


* Indicates a significant chi square was found in a Friedman two-way analysis of variance. 


+ 0—wrong direction—wrong probability. 
1—right direction—wrong probability. 
1—right probability—wrong direction. 
2—right direction—right probability. 


Friedman two-way, non-parametric analy- 
sis was conducted the accuracy 
scores for the three main effects format, 
number points, and missing data. The means 
for the nine treatment combinations each 
were used the source variation. The 
means for these variables are shown Table 
III. The almost identical means for the repli- 
cations did not require analysis. This 
analysis, however, resulted significant 
differences among the levels for all the remain- 
ing variables. 

order determine whether not the 
same interaction existed for accuracy did for 
time scores, two-way Friedman analysis 
variance was also conducted for each format 
missing-data level. significant effects were 
found. The poor discriminating power this 


DISCUSSION AND CONCLUSIONS 

The significant effects format both 
speed performance and accuracy perform- 
ance indicate clearly that the line graph resulted 
superior performance compared with the 
vertical-bar horizontal-bar type. The superi- 
ority the line and vertical-bar graphs over 
the horizontal bar may partly attributed 
the fact that the two axes are reversed for the 
horizontal-bar graph; that is, time the 
vertical axis and number the horizontal 
axis. 

The interaction between format and missing 
data indicates that the higher level missing 
data (one-third missing), the three formats 
not differ significantly. This probably due 
the fact that the task difficult that the 
differences format are relatively unimportant. 
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The number-of-points variable can viewed 
type irrelevant data situation. The 
subject must search for particular set four 
six points context points which are 
value. The degradation performance 
that results from increase irrelevant points 
indicates that for situations comparable these 
experimental conditions would better 
display only the minimum number points 
that will needed looking for trend. 
The effects missing data performance 
would lead one attempt supply missing 
data all possible graphic trend. The 
significance replication the analysis 
variance for time scores demonstrates that 
performance improved from the first the 
second replication. The subject replication 
interaction reveals that this change perform- 
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ance greater for some subjects than for others, 
Accuracy scores, however, did not reflect any 
significant learning from one replication the 
other. 

The major conclusion this study is: 


Line-type graphs should used show 
time-correlated data. second choice 
made, the vertical-bar type recom- 
mended. 
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Evaluation Methods for 


Presentation Graphic Multiple 
Trends—Experiment 


HOWARD SCHUTZ, Battelle Memorial Institute, Columbus, Ohio. 


The primary objective this study was determine the effect multiple-line 
versus multiple-graph presentation trend-type displays operator performance. 
Four types lines having low confusability were determined experimentally from 
sample twenty-five lines. The primary variable was single-graph, multiple-line 
presentation versus multiple-graph single-line presentation. Other variables included 
this study were: number lines, degree confusion among lines, coding lines, 
and two operator tasks: point-reading and comparing. was found that for the 
point-reading task, either type display acceptable, but for the comparing task, 
the multiple-line display much superior the multiple-graph display. Moreover, 
the use color coding for the graph lines tended improve performance slightly. 


INTRODUCTION 


The third paper this led the 
conclusion that the line graph preferred for 
displaying single-trend data. The present 
experiment concerned with methods 
presenting multiple trends. Two major alter- 
natives exist: (1) display several trend lines 
single graph, (2) display single trend lines 
several graphs. The existing human-engin- 
eering literature does not contain direct com- 
parisons these two display methods. 

the number trend lines increased, the 
multiple-line display might result confusion 
among lines. This kind confusion would not 
found the multiple-graph situation. 
the other hand, making comparisons among 
lines might prove more difficult the 
multiple-graph situation because the larger 
separation between lines. From the standpoint 
space, the multiple-line presentation 
obviously superior, but the price paid per- 
formance may high. With such questions 
mind, experiment was designed com- 
pare multiple-line with multiple-graph presen- 
tations. Four secondary independent variables 
were included the study achieve greater 
generality well determine their own 


This work was sponsored the U.S. Air Force 
under Contract (ref. 
201). 


effects operator performance. These secon- 
dary variables were: (1) number trend lines 
displayed, (2) confusability trend lines, (3) 
color coding versus black and white, and (4) 
graph-reading tasks. 

preliminary experiment was conducted 
obtain line codes that would help keep lines 
distinct the multiple-line displays. This 
preliminary study will reported first, and 
then the multiple-line versus multiple-graph 
experiment will presented. 


PRELIMINARY EXPERIMENT 
EVALUATION CODES FOR 
BLACK AND WHITE LINES 


Many varieties line codes are currently 
used graphs. (Each experimenter apparently 
has his favorite line codes for graph construc- 
tion.) Some lines are easily confused with each 
other, while others are quite discriminable. 
This preliminary study was conducted for the 
purpose obtaining set minimally con- 
fused lines for the multiple- 
graph study. assumption was made that 
the degree which lines would confused 
when presented singly for short time intervals 
under poor viewing conditions would com- 
parable with the confusion resulting from 
high degree crossing among set lines 
graph. 
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Method 

Selection and preparation styles. 
Twenty-five lines varying style were 
selected from among the almost limitless 
variety found use. Preference was given 
lines with relatively simple construction 
which would more amenable presentation 
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Materials. experimental materials con- 
sisted the fifty 35-mm slides described above, 
rear-projection facility and subject response 
box with twenty-five push-buttons. The experi- 
menter observed the subject’s responses with 
similar box containing lights corresponding 
the buttons the subject’s response box. 


19. @ee—eee 


24. 


Twenty-five lines used line confusion study. 


electronic equipment, such might used 
intelligence system. Each line was drawn 
35-mm slide. This was done twice yield 
total fifty slides, two for each line. Examples 
the lines selected are shown The 
projected line length was in. and the width 
was in. 


Subjects. Ten subjects professional level 
were drawn from the available pool subjects. 

Experimental Procedure. Each subject was 
given the twenty-five lines twice random 
order. The exposure time was 0.2 sec. The 
image was blurred defocusing order 
produce degree confusion comparable 
with that resulting from viewing single 


nce. 
rom 
the 
ver, 
on- 
nes 
(3) 
(4) 
to 
nes 
his 
ind 
Zi. 
uc- 
the 
hat 
sed 
als 
m- 


110 July, 1961 


graph with many crossing lines. The 
subjects were instructed identify the line 
shown the screen depressing the appro- 
priate response button. They were told that 
any line could appear any number times. 
The sessions were self-paced and lasted approx- 
imately min. Each subject was presented 
all fifty slides during experimental session. 

Analysis the data and results. The first 
step the data analysis was the construction 
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stimulus lines and the responses made 
them are presented Table 


table shows what proportion the time each 
stimulus was identified one the twenty- 
five possible stimuli. The stimulus lines pre- 
sented are found across the top the table and 
the possible responses are presented along the 
side. The values the cells represent the 
proportion times particular response was 


TABLE 
Confusion Matrix 
Stimulus 


N 


Response 


oo 


NR 
CO 


N 
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The proportion of total stimulus presentations resulting in each response. Decimal point omitted. 
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made given stimulus. Numbers the 
diagonal represent the proportion times 
stimulus was identified correctly. 

Using the constant-ratio this matrix 
was examined find possible submatrices 
four lines which would result the least 
amount confusion. submatrix was found 
which had confusions among the four lines 
which was composed. other words, 
one these lines was ever identified one 
the other lines. This submatrix was made 
the following lines: 


(No. 
(No. 

(No. 13) and 
(No. 11) 


The assumption made that only these four 
lines were presented, the results would have 
been 100 per cent correct identifications. 


Conclusions 


Four-line styles were selected which were 
considered maximally discriminable set line 
styles. These styles, codes, not represent 
the only such set lines, course, but they 
meet the needs the major experiment 
multiple-line, multiple-graph display 
niques. 


MAJOR EXPERIMENT: MULTIPLE- 
TREND DISPLAYS 


Experimental design 


The design was com- 
plete factorial with two replications. The first 
variable was type display; that is, multiple 
line multiple graph. The second variable 
was number lines, which had three levels: 
two, three, and four lines. The third variable 
was degree confusion among lines and had 
two levels: low confusion and high confusion. 
The fourth variable was task variable and 
consisted two types tasks: point reading 
and comparing. The fifth variable was type 
line coding: color black and white lines. 
Ten subjects constituted the sixth variable. 
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The multiple-line and multiple-graph dis- 
plays included the same data. the multiple- 
line displays, three, four lines were 
presented single graph. For the multiple- 
graph displays, the same lines were displayed 


Time 
Multiple line 


Time 
Multiple graph 


Fig, Examples multiple-line and multiple-graph 


vertical array two, three, four graphs— 
one line each graph. Fig. shows the same 
data presented both methods. 

The use two, three, and four lines the 


Stimulus figures reshown from print 
the original 3-mm slide material and are reasonable 
facsimiles rather than exact representations. 
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experiment resulted from desire make the 
results more general than only two lines had 
been used. Also, differences between the two 
types presentation might depend the 
number lines graphs involved. 

Degree confusion was also varied the 
experiment. For low confusion, the lines never 
crossed. For high confusion, the lines crossed 
four, seven, and ten times for the 2-, 3-, and 
4-line conditions, respectively. Fig. shows 


Number 


Number 


Time 
High confusion 


Fig. Example low and high confusion among 


lines. 


example low and high confusion conditions 
for four lines multiple-line display. 

Two types coding, color and black and 
white, were used the experiment. The use 
color aid visual displays often 
recommended, but sound experimental evi- 
dence concerning its contribution not avail- 
able. The four black and white codes used 
the present experiment were selected from the 
preliminary study. Four colored 
yellow, green, and purple—were selected from 
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list recommended colors given Conover 
and Kraft.? 

The experiment included two operator tasks: 
point reading and comparing. These tasks 
represent two basic operations that are impor- 
tant most graph applications. The point- 
reading task consisted reading vertical-axis 
values from specified horizontal-axis values for 
given line. The comparing task consisted 
determining the with the highest value 
the vertical axis for specified values the 
horizontal axis. 

These five variables resulted forty-eight 
fixed experimental conditions. These condi- 
tions were presented ten subjects two 
different occasions. 


Method 


Display. represent the forty-eight fixed 
conditions, six basic sets points the graph 
were constructed. The horizontal axis repre- 
sented time and the vertical axis represented 
number. All experimental conditions con- 
tained the same set six points the appro- 
priate form for that experimental condition. 
Fig. shows all six basic sets displays for the 
multiple-line and black-and-white codes. Grid 
lines were placed each unit division both 
the horizontal axis and vertical axis aid 
reading the numerical values. Small pips 
marked the halfway points between units 
additional aid. The forty-eight drawings were 
photographed Super Anscochrome 35-mm 
film which yielded positive transparencies. 
Four practice slides were constructed: (1) 
multiple-line, two-line, black-and-white; (2) 
same the first but color; (3) multiple- 
graph, two-line, black-and-white; and (4) same 
the third but coior. The projected sizes 
the displays were follows: single graph— 
in.x in.; two graphs—12} in. in.; 
three graphs—19} in.; four graphs— 
26} in. in. 

Certain conventions were followed com- 
bining the number lines and code variables. 
The two-line codes were composed 
and The three-line codes used 
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The four-line codes used all four styles. For 
the color condition, red and green were used 
for two-line codes; red, green, and yellow 
were used for three-line codes. 

Test booklets. test booklets were 
assembled, ten for each replication. Each book- 
let consisted fifty-two pages. The first four 
pages were used with the practice slides and the 
next forty-eight with the experimental condi- 
tions. The four practice slides were the same 


Number 
Number 


July, 1961 113 


half-interval units. The ten sets five ques- 
tions were assigned the forty-eight experi- 
mental conditions such manner that each 
condition would tested equal number 
times for given set five time values. The 
lines utilized for the point-teading task were 
assigned random manner. 

Equipment. The projector 
timing system were those described the first 
paper this series.* 

Subjects. Ten male Battelle employees the 


Number 
Number 


Time 


Time Time 


Fig. The six basic sets points used for all experimental conditions. 


order for all subjects, but the order was 
random for the forty-eight experimental condi- 
tions. 

obtain sample performance for the 
tasks, each page the test booklet there 
appeared five time values, for which the subject 
was instructed read off the numerical value 
given line else specify which line was 
highest, depending whether was point- 
reading comparing task. These five values 
were chosen from set ten randomly 
selected time values from the eleven possible 


professional level were selected from the pool 
available subjects. 

Training. The training consisted orien- 
tation period which the subjects were told 
the purpose the study, shown the types 
presentation, and given specific instructions 
the procedures used the experiment. 
Only minimum amount training was con- 
sidered necessary, inasmuch the task was one 
with which the subjects were already familiar. 

Experimental procedure. The ten subjects were 
tested individually two different occasions, 
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once for each replication. Each subject was 
first given the four practice slides, then the 
forty-eight experimental slides. The subject 
was given task booklet selected random 
and instructed read the first page deter- 
mine what line was utilize and whether 
paring task. The subject would then depress 
push-button which brought the first slide. 
After answering the five questions for that 
slide, was instructed depress the push- 
button again, removing the slide. The experi- 
menter then recorded the time elapsed since the 
slide appeared before the subject and signalled 
the subject proceed the next page the 
booklet. Thus, the progress the test session 
was essentially self-paced. This procedure was 
followed for the remaining three practice slides 
and for the forty-eight experimental slides. 
Each experimental session lasted approximately 
min. Seating and lighting arrangements 
were identical those described the first 
paper this 
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After the experiment was completed, each 
subject rank ordered the display conditions 
indicate how much liked using them. 


Results 


Treatment the data. The time scores were 
organized the forty-eight treatments, and 
means over ten subjects were computed for 
each replication. The accuracy scores (number 
right) were combined the same 
There were very few errors (only out 960, 
1.33 per cent), and the errors that did occur 
were not concentrated any one treatment. 
Therefore, further analysis the accuracy 
data was necessary. 

determine the reliability 
measurement for this experiment, the means 
computed for the ten subjects for the forty- 
eight treatments the first replication were 
correlated with the corresponding data for the 
second replication. This correlation was 0.98, 
indicating that the pattern means for the first 
and second replications was essentially the same. 


TABLE 
Summary Analysis Variance for Time Scores 
Source variance Mean square Error term 

Subjects (S) 0.6410 Replication 75.54* 
Display (D) 1.6769 88.72* 
Number lines (N) 0.0616 11.94* 
Confusion (C) 0.5246 111.88* 
Task (T) 2.0922 840.58* 
Line code (L) 0.1081 17.56* 
0.1299 SDN 15.48* 
1.6644 SDT 195.05* 
0.0206 SDL 2.98 
0.0830 SNC 14.13* 
0.0504 SNT 10.06* 
0.0132 SNL 2.35 
0.1566 SCT 21.62* 
0.0167 SCL 2.36 
0.0294 STL 4.45 
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Source variance 

DNC 
DNT 
DNL 
SDN 
DCT 
DCL 
SDC 
DTL 
SDT 
SDL 
NCT 
NCL 
SNC 
NTL 
SNT 
SNL 
CTL 
SCT 
SCL 
STL 
DNCT 
DNCL 
SDNC 
DNTL 
SDNT 
SDNL 
SDCL 
SDCT 
DCTL 
SDTL 
NCTL 
SNCT 
SNCL 
SNTL 
SCTL 
DNCTL 
SDNCT 
SDCTL 
SDNTL 
SDNCL 
SNCTL 
SDNCTL 
Replication 


Mean square 


0.0025 
0.0062 
0.0024 
0.0599 
0.0010 
0.0084 
0.1182 
0.0032 
0.0089 
0.0025 
0.0085 
0.0069 
0.0233 
0.0192 
0.0059 
0.0098 
0.0050 
0.0056 
0.0027 
0.0072 
0.0071 
0.0066 
0.0300 
0.0292 
0.0033 
0.0064 
0.0054 
0.0052 
0.0035 
0.0051 
0.0185 
0.0061 
0.0040 
0.0052 
0.0059 
0.0075 
0.0055 
0.0034 
0.0035 
0.0091 
0.0091 
0.0075 
0.0113 
0.0084 


0.05 


Error term 
Replication 
Replication 
SDNC 
SDNT 
SDNL 
Replication 
SDCT 
SDCL 
Replication 
SDTL 
Replication 
Replication 
SNCT 
SNCL 
Replication 
SNTL 
Replication 
Replication 
SCTL 
Replication 
Replication 
Replication 
SDNCT 
SDNCL 
Replication 
SDNTL 
Replication 
Replication 
Replication 
Replication 
SDCTL 
Replication 
SNCTL 
Replication 
Replication 
Replication 
Replication 
SDNCTL 
Replication 
Replication 
Replication 
Replication 
Replication 
Replication 


July, 1961 115 


11.04* 
re 
23.23* 
er 
1.04 
1.01 
3.27 
1.36 
rst 9 
1e. 9 
5.43* 
3.20 
y 
5.34* 
1.07 
1.07 
1.33 
480 


116 July, 1961 


Analysis variance. The raw time scores 
were converted logarithms order more 
nearly meet the assumptions underlying analysis 
variance. addition, because the char- 
acteristic positively skewed distribution 
time scores, logs yield more valid measure 
central tendency—the geometric mean— 
than would arithmetic mean. 

six-way mixed model the analysis 
variance was conducted the log scores. The 
results are summarized Table II. All main 
effects, six two-way interactions, three three- 
way interactions, and two four-way interactions 
were significant. 

The means for all fixed main effects are given 
Table III. The significance the differences 
between pairs means was computed with 
the Duncan multiple-range All the values 
were significantly different from one another 
except the three- and four-line conditions the 
number-of-lines variable. 

Two the important two-way interactions 
are shown Tables and From Table 
clear that for either two, three, four 
lines, the multiple-line display superior 
performance the display. 
interesting note than increase the 
number lines had effect multiple lines, 
while did produce increasingly poorer per- 
formance for multiple graphs. Table 
cates that for the point-reading task there 
difference between multiple lines and multiple 
graphs but that the multiple line superior 
for the comparing task. 

The only significant subject interaction was 
subject display condition. All subjects per- 
formed better with the multiple-line display 
than they did with the multiple-graph display, 
but for some subjects this superiority was 
greater than for others. 

the three significant three-way inter- 
actions, the one which most interest for 
comparing multiple-line and multiple-graph 
displays the display confusion task inter- 
action. This three-way interaction presented 
Table VI. Examination this table indicates 
that for the point-reading task, the multiple-line 
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TABLE 


Geometric Means for Fixed Main Effects 


Type display 


Multiple line Multiple graph 
19.18 23.25 
(b) lines 
Confusion among lines 
Low confusion High confusion 
20.01 22.28 
Task 
Point reading Comparing 
18.97 23.51 
(e) Line coding 
Black and white Color 
21.64 20.61 


(1) Means reported seconds. 
(2) Values connected line are not significantly 


TABLE 
Geometric Means for Type Display Task 


Task 


Type display 


Multiple line 18.95 19.40 
Multiple graph 28.49 
Notes: 


(1) Means reported seconds. 
(2) Values connected line are not significantly 


Point reading 


TABLE 


Geometric Means for Type Display Number 
Lines 


Number lines 


Multiple line 19.42 19.30 18.81 


Notes: 
(1) Means reported seconds. 


(2) Values connected line are not significantly 


t 
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display affects performance adversely with 
increased confusion, whereas the multiple 
graph does not. For the comparing task, both 
types display conditions affect performance 
adversely the addition confusion. 

The two four-way interactions contained all 
the variables except subjects. These two four- 
way interactions are shown Tables VII and 
organized that differences between 
the multiple-line and multiple-graph presenta- 
tions are apparent. 

can seen Table VII that for the point- 
reading task, for either high low confusion 
two, three, four lines, there essentially 
difference between performance using 
multiple-line presentation. 
For the comparing task, multiple lines are 
significantly better than the multiple graphs 
for both low and high confusion, with the 
difference generally becoming greater under 
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the high confusion and under the greater 
number-of-lines conditions. 

Examination Table VIII reveals some 
additional information when color and black- 
and-white line codes are considered. For point 
reading under low confusion, there are 
significant differences between multiple lines 
and multiple graphs, and color improves 
performance for both. For high confusion, 
there are significant differences between 
multiple-line and displays; 
however, color improves the multiple-line but 
not the multiple-graph presentation. 

Under the comparing task, multiple lines are 
significantly better than multiple graphs for 
both levels confusion well for both line- 
coding methods. 

The results the preference ranking are 
shown Table IX. For the point-reading task, 
the subjects generally preferred the multiple-line 


TABLE 
Geometric Means for Display Confusion Task 
Task 
Type display Point reading Comparing 
Low confusion High confusion Low confusion High confusion 

Multiple line 19.87 18.36 20.50 
Multiple graph 19.0 25.49 31.85 
Notes: 


(1) Means reported seconds. 


(2) Values connected line are not significantly different 0.05. 


TABLE 
Geometric Means for Display Number Lines Confusion Task 


Point reading 
Low confusion 


High confusion 


Comparing 


Low confusion High confusion 


Type of display Lines Lines Lines Lines Lines Lines Lines Lines Lines Lines Lines _ Lines 


Multiple line 


18.94 19.79 16.52 21.12 20.54 19.86 
Multiple 23.83* 27.30 25.42 26.18 32.94 37.46 


Notes: 
(1) Means reported in seconds. 


(2) Values connected line are not significantly different 0.05. 


* This value also not significantly different from 4-line value. 
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Point reading 


TABLE 
Geometric Means for Display Confusion Task Line Code 
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Comparing 


Type display Low confusion High Low confusion High 
and white Color and white Color and 
Multiple line 18.89 19.02 19.38 17.40 20.46 20.53 
Notes: 


(1) Means reported seconds. 


Point reading 


Display Line Code Mean rank 
Multiple graph Colored 1.7 
Multiple line Colored 2.2 
Multiple graph Black and white 2.7 
Multiple line Black and white 3.4 


1=Most preferred. 
Least preferred. 


and multiple-graph displays color their 
black-and-white counterparts. For the com- 
paring task, the multiple-line presentation 
either color black and white was preferred 
the multiple-graph presentation. These 
findings follow the same general trends 
found the time-score analysis. 


DISCUSSION AND CONCLUSIONS 


The results the time-score analysis indicate 
that for the most accurate prediction per- 
formance, consideration should given 
the two four-way interactions: graph task 
number lines confusion, and graph task 
confusion code. The results for both inter- 
actions reveal that the display method has little 
bearing the point-reading task. For the 
comparing task, however, the multiple-line 
display always superior. The preference 
results lend weight these findings. 


(2) Values connected line are not significantly different 0.05. 


TABLE 
Preference Ranking for Displays and Line Code Task 


Comparing 
Display Line code Mean rank 
Multiple line Colored 1.2 
Multiple line Black and white 1.8 
Multiple graph Colored 3.3 
Multiple Black and white 3.7 


Inasmuch the use color always 
perplexing problem the design engineer, 
perhaps the results for this variable should 
examined more closely. general, can 
concluded that color improves performance for 
the point-reading task but not for the compar- 
ing task. This difference, however, small 
absolute sense. The greatest effect that 
color had was improving performance with 
the multiple-line display. The finding that 
color did not have more profound absolute 
effect can partly attributed the fact that the 
black-and-white line codes were selected 
optimally discriminable set. Thus, appears 
that color, with its usual concomitant increase 
cost and time, not necessary for good 
operator performance highly discriminable 
black-and-white line code utilized. 

The specific conclusions from this study are: 


(1) information about the task re- 
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quired the operator not available, 
the multiple-line display recom- 
mended over the multiple-graph display. 

(2) the task known, either the multiple- 
line multiple-graph display can 
used for the point-reading task. The 
multiple-line display, however, recom- 
mended for the comparing task. both 
tasks are involved, then the 
line display superior for overall 
performance. 

(3) cost time process visual materials 
are not important factors, color may 
used for coding purposes improve 
performance slightly. 
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Evaluation Five Different Abstract 
Coding Methods—Experiment IV, 


WILLIAM HITT, Battelle Memorial Institute, Columbus, Ohio 


The purpose this study was ascertain the relative effectiveness selected abstract 
coding methods, based upon their effects various operator tasks. Five different 
coding methods were selected: numeral, letter, geometric shape, color, and configur- 
ation. Secondary variables included the study were target density, number 
code levels, and operator tasks. was found that numeral coding and color coding 
are the two superior coding methods. greater emphasis placed identi- 
symbols, numeral coding superior color coding. significant differences 
were found, however, between numeral coding and color coding for the remaining 
operator tasks: locating, counting, comparing, and verifying. 


INTRODUCTION 


Abstract coding generally accepted 
useful technique for representing targets 
visual displays. Introducing realism coding 
means either words symbols often 
not practical even possible. would 
almost impossible, for instance, incorporate 
high degree realism coding the many 
types radar sites, missile sites, aircraft 
portrayed visual displays intelligence 
centers. For one reason, the differences be- 
tween items within single category are fre- 
quently too subtle portrayed pictorially. 
Moreover, spell out all these items 
readable manner would require considerable 
space the display. therefore seems essen- 
tial that some form abstract coding used. 

number studies have been conducted 
compare code levels within single code cate- 
gory. For instance, experiments have been 
conducted find optimum set discrimin- 
able colors. Work also has been done the 
discriminability letters and numbers. More- 
over, research has been conducted 
mine the degree confusion among various 
geometric shapes. the basis such re- 
search, now possible obtain satisfactory 
discriminability for code levels within selected 
code categories. Very little work has been done, 
however, compare the effectiveness one 
code category with the effectiveness second 


This work was sponsored the U.S. Air Force 
under Contract (ref. 
201). 


code category, such color coding versus 
geometric-shape coding, numeral coding 
versus letter coding. 

review the literature uncovered only 
three studies that were particularly pertinent 
the comparison code categories. 
investigated speed locating objects 
visual display when the various classes 
objects the display differed from one another 
only one the four dimensions form, 
hue, size, and brightness. found that loca- 
tion time for hue differences was significantly 
shorter than for form differences, and that 
location times for hue and form were signi- 
ficantly shorter than for either brightness size. 

study Anderson and Fitts,? groups 
homogeneous color numeral symbols 
were exposed tachistoscopically for 0.1 sec. 
Maximum average information transmitted 
about color was 10.44 bits per exposure, and 
maximum average information transmitted 
about numerals was 14.94 bits. 

Alluisi and Muller! studied the information- 
handling performance subjects with con- 
ventional Arabic numerals and six other sym- 
bolic visual codes under both motor (key 
pressing) and verbal-response conditions. The 
six symbolic codes included set straight- 
line symbolic Arabic numerals, three sets 
ordered symbols based upon differences the 
visual inclination line, set colors, and 
set ellipses differing axis ratios. 
first experiment, subjects responded pressing 
one number finger keys for each the 
symbols presented. second experiment, 
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subjects responded verbally calling out the 
number assigned each stimulus symbol. 
The seven codes fell into three clearly different 
groups under each response condition: the 
two numeral codes were superior the three 
inclination codes, and these were all superior 
the two remaining codes color and ellipse- 
axis ratio. 

Thus, even though only limited number 
studies have been conducted evaluate the 
relative effectiveness display categories, the 
results indicate least one apparent incon- 
sistency. Eriksen found hue superior 
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literature visual displays did not reveal any 
previous attempt test this conjecture. 

The objective this study, then, was 
ascertain the relative effectiveness selected 
abstract coding methods, based upon their 
effects various operator tasks. 


METHOD 
Design Experiment 
Three major steps were involved the 
design the experiment. First, was neces- 
sary decide which variables include the 
experiment. Next, was necessary specify 


ABCDEFGH 


*™ No attempt was made to hold saturation and brightness constant 


The five code categories. 


form coding objects visual displays. 
Anderson and Fitts, well Alluisi and 
Muller, the other hand, found numerals 
superior color. 

One possible explanation for these discrepant 
results that the task required the subjects 
was not the same all three studies. The 
subjects Eriksen’s study were required 
locate objects, whereas the subjects the other 
two studies were required identify objects. 
the basis the difference task required 
the subject, indeed plausible assume 
significant interaction between visual display 
conditions and operator tasks. review the 


the levels steps over which manipulate 
the selected variables. The final task was 
organize these variables suitable manner 
produce well-controlled experimental design. 

Five different coding methods were selected: 
numeral, letter, geometric shape, color, and 
configuration. The first four coding methods 
are rather obvious techniques consider, and 
the fifth modification the inclination 
codes used Alluisi and the 
basis experimental evidence which indicates 
that more than approximately nine different 
hues can discriminated absolute basis,* 
the upper limit for number code levels was 
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the five code categories are presented Fig. 

achieve high degree generality the 
evaluation these five coding methods, the 
number code levels and the target density 
were included the study secondary inde- 
pendent variables. The number code levels 
was varied over two, four, and eight levels. 
Target density was varied over 40, 80, and 120 
symbols per display. 

Since the objective the study was deter- 
mine the effectiveness selected abstract 
coding methods relation operator tasks, 
operator task was also included inde- 
pendent variable. According somewhat 
general analysis the system under study, five 
different operator tasks appeared basic 
visual display reading. These tasks were: 
identifying, locating, counting, comparing, and 
verifying. 

was decided select five males from 
Battelle’s professional research staff serve 
subjects the experiment. 

order test for important interactions 
between variables, the experiment was designed 
complete factorial for the variables des- 
cribed above. That is, with subjects being 
“random” and all other variables being 
factorial coding methods, code 
levels, densities, tasks, and subjects). 

Inasmuch both speed and accuracy 
performance are important for the system under 
study, number correct responses per experi- 
mental condition and speed response 
per experimental condition 


chosen eight. The eight levels for each 


TABLE 
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the measures operator performance. 

Information believed representative 
the inputs into intelligence center was 
developed the form eight items under 
each five target categories: Industry, Per- 
sonnel Buildings, Radar Sites, Aircraft, and 
Defense Units. These target categories, which 
constitute the information represented 
the abstract codes, are presented Table 
All five target categories were included under 
each the 225 experimental conditions. 

complete the experimental design, several 
additional control variables were taken into 
consideration. These control variables were 
incorporated either random partially 
counterbalanced manner. The counterbalanc- 
ing technique was used that the same code 
the same test category would not pre- 
sented the same subject two successive 
occasions, which might have resulted un- 
wanted transfer effects. 

control for warm-up and fatigue effects 
within single experimental session, the order 
presentation experimental conditions 
within session was completely randomized. 
control for day-to-day learning effects, 
well for other causes intrasubject varia- 
bility, the order presentation for experi- 
mental conditions over sessions was partially 
counterbalanced. 


Presentation Materials 


eliminate the possibility favoring one 
code category over another, available human- 
engineering design principles were applied 
the design all displays. The selection 


Target Categories 


Item Industry Personnel buildings Radar sites Aircraft Defense units 
plant Command post Early warning Interceptor Army unit 
refinery Barracks Antiaircraft Short-range bomber Navy unit 
warning 
Lead refinery Prison Gap filler Tanker Coast Guard unit 
mill Hospital Texas tower Transport Marine unit 
assembly plant Theater Airborne search Trainer Civil Defense unit 
plant Mess hall Picket line Civil National Guard unit 
plant School Civil surveillance Helicopter Military Reserve 


unit 
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colors, configurations, and geometric shapes, 


for instance, was based upon the results pre- 
was research; the size symbols—} in. for 
dimension—was based upon specific 
Per- human-engineering 
and The displays were rectangles 
Fig. coding: eight levels, high density. 
depending upon the density level being repre- 
sented. The location symbol within cell 
was determined random manner. The 
types targets within code category were 
represented equal number times all 
displays. All nine displays one code category 
corresponded exactly the nine displays for 
any the four other code categories, except, 
display, and 1-in. red letters along the 
system. 
For each the five code categories nine 
display posters were prepared (i.e. for three 
Fig. Configuration coding: eight levels, low den- 
sity. 
course, for the type targets. Examples 
the display posters are presented Fig. 
through 
set 2-in. training cards was prepared 
for each the five code categories. Except 
for being larger size, the symbols these 
cards were exact replicas the target symbols 
the posters. The cards were constructed for 
the purpose teaching subjects how encode 


Fig. coding: four levels, high density. and decode the target categories. 
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Pencil-and-paper tests were constructed 
measure the five operator tasks. subset 
questions for single display poster consisted 
questions—five questions for each the 
five tasks. Thus, for set nine display 
posters, basic set 225 questions was con- 
structed. This basic set 225 questions was 
written five different times constitute five 
equivalent forms the same test—one form 
for each five target test categories. Examples 
the questions are listed Table II. 


TABLE 


Examples Questions Measure Five Operator Tasks 


Identify: What type aircraft 4-C? 
(b) Short-range bomber......... 
(c) Long-range 
(d) Tanker 


Locate: 


Which column contains one cell 
with only early warning radar 


Count: How many aluminium plants are 


Row 


Does 2-D contain the same com- 
position defense units 8-C? 


Compare: 


Verify: The personnel buildings 4-D 
are command posts. 


Experimental Procedure 


The subjects were tested for visual acuity 
and color vision prior the first experimental 
trial. Detailed instructions were given the 
subjects, which time the experimenter 
emphasized the importance both speed and 
accuracy 

The first part each experimental session 
involved teaching the subject the associations 
for the code category/target category combin- 


HUMAN FACTORS 


ation which was specified for that particular 
day. The experimenter stated the associations 
for the entire sequence twice succession, 
showing the subject the training card 
stated the corresponding item the target 
category; for example, “Black represents 
interceptor, red represents 
bomber, blue represents long-range bomber, 
etc.” The subject then practiced identifying 
the codes until achieved 100 per cent 
criterion twice succession. 

Next, the subject was instructed read the 
five test items the first page test booklet. 
had any questions, they were answered 
the experimenter. When the subject signaled 
was ready commence, the experimenter 
raised blind that covered the display poster 
and, simultaneously, started the timer. Imme- 
diately after the subject completed the fifth 
question, again signaled the experimenter, 
who stopped the timer, lowered the blind, and 
then recorded the time. This procedure was 
followed throughout experimental session. 

During each experimental session, subject 
completed experimental five 
tasks three target densities, with code level, 
code category, and target test category held 
constant. experimental session lasted be- 
tween and min. the rate condi- 
tions per session, experimental sessions (one 
per day for successive work days) were 
required for subject complete the 225 
experimental conditions. the completion 
the experiment, all five subjects had com- 
pleted the necessary trials for all 225 experi- 
mental conditions. 


Cross-Validation Experiment 


order obtain estimate the amount 
error the experiment and better char- 
acterize the population subjects from which 
the original sample five was drawn, the 
entire experiment was repeated second 
group five subjects. This cross-validation 
experiment was conducted the same manner 
the original experiment, except for two 
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changes: (1) different group five subjects 
(who were also professional research scientists 
representing various scientific disciplines) were 
selected, and (2) slides were used rather than 
posters for presentation stimulus materials. 
This latter change was made because the 
noticeable wear the posters after the com- 
pletion the first experiment. 


RESULTS 


achieve approximately normal distri- 
bution scores, well make use both 
performance measures, accuracy scores and 
speed scores were combined the form 
“number correct responses per minute”. 
The product-moment correlation between the 
accuracy scores and speed scores for the first 
replication was —0.82, but, nonetheless, when 
plotted alone, each measure formed highly 
skewed distribution. Combining the scores, 
however, resulted both normality distri- 
bution for al! scores combined and homo- 
geneity variance for the experimental condi- 
tions. 

estimate intersubject reliability for the 
first experiment was obtained computing the 
average correlation coefficient between sub- 
jects over the 225 experimental conditions. 
This correlation was found 0.78, which 
indicates rather high degree consistency 
performance among the five subjects. 


INTERCORRELATION AND FACTOR 
ANALYSIS FOR OPERATOR TASKS 


was next desired determine the degree 
relation between the five operator tasks. 
treating the mean scores for subjects indivi- 
dual scores, the five tasks were intercorrelated 
over the remaining experimental conditions. 
These intercorrelations are reported the 
upper right portion Table III. 

order determine the extent which 
these five tasks could reduced smaller 
number basic dimensions, the matrix inter- 
correlations for the first experiment was factor 


July, 1961 125 


analyzed means the centroid method. 
The two factors presented Table III (b) were 
obtained from this analysis. use simple 
structure the criterion for rotation, these two 
orthogonal factors were rotated produce the 
transformed factors Table III (d). Fig. 
represents graphic plot the two rotated 
factors. clearly seen from this figure that 
locating and identifying (or search and recogni- 
tion) represent two independent operator tasks. 
the other hand, the verifying, counting, and 
comparing tasks are loaded both these 
factors. 


Locote 
@ Verify 
80 @ Count 
Compare 
40 
.20 Identify 


Fig. graphic plot rotated factors. 


Analysis Variance 


mentioned previously, the experimental 
design was 5x5x3x3x5 factorial, with 
subjects considered “random” and the other 
variables considered The complete 
analysis variance, which tested for all main 
effects and for all interactions except the five- 
way interaction, presented Table IV. 


The relative effectiveness the five code 
categories, based upon their effects operator 
tasks, shown Table The code categories 
are rank ordered each the tasks according 
Code categories connected the horizontal 
lines are not significantly different 0.05. 
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TABLE 


Intercorrelation Matrix and Factor Matrix for Tasks (for First Replication) 


(a) Intercorrelations and residuals 


Identify 
Locate —0.02 


Verify 


0.89 
0.81 


Correlations: upper right; residuals: lower left. 


(b) Unrotated factors 


Transformation matrix 


Rotated factors 


(37 degrees clockwise) 
Identify 0.46 0.56 Identify 0.03 0.73 0.53 
Locate 0.71 —0.50 Locate 0.87 0.02 0.76 
Compare 0.94 0.18 Compare 0.64 0.70 0.91 
Verify 0.89 Verify 0.87 0.33 0.87 


can seen from Table that, general, 
color coding and numeral coding are the two 
superior coding methods. For the identifying 
task, however, numeral coding ranked first 
and color coding ranked fourth. the 
other hand, color coding not significantly 
different from numeral coding the remain- 
ing tasks. 

Tables and VII indicate, respectively, the 
effect number code levels and the effect 
target density operator performance. 
might expected, increases both number 
code levels and target density degrade 
operator performance. interesting note 
that, both cases, the decrease performance 


from the first level the second level rela- 
tively large, and then from the second level 
the third level there appears leveling-off 
effect. 


Cross-Validation Experiment 


correlation between 
mean subject performance for the first experi- 
ment and mean subject performance for the 
second experiment, based upon 225 
experimental conditions, was found 0.97. 
With such small amount error the experi- 
ment, apparent that, for all practical pur- 
poses, any interpretation made the results 
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TABLE 
Summary Analysis Variance 
Source 
variance Mean square Error term 
Subjects (S) 256.7973 Residual 153.77* 
Codes (C) 390.4855 17.78* 
Levels (L) 404.4655 99.87* 
Density (D) 1456.7000 156.63* 
Tasks (T) 1649.4250 182.46* 
21.9554 Residual 13.15* 
4.0504 Residual 2.42* 
9.2954 Residual 5.57* 
9.0401 Residual 5.41* 
24.9318 SCT 7.99* 
10.8688 SLD 4.49* 
359.0986 SLT 73.89* 
78.6800 SDT 28.10* 
SCE, 31.1250 Residual 18.63* 
SCD 4.2586 Residual 
SCT 3.1227 Residual 1.87* 
SLD 2.4152 Residual 1.45* 
SLT 4.8643 Residual 2.91* 
SDT 2.8027 Residual 1.68* 
CLD 2.4400 SCLD 
CLT 2.8900 SCLT 
CDT 2.1627 SCDT 1.14 
LDT 71.4916 SLDT 20.66* 
SCLD 3.5725 Residual 2.14* 
SCLT 128 3.1179 Residual 1.87* 
SCDT 128 1.8964 Residual 1.14 
SLDT 3.4657 Residual 2.07* 
CLDT 2.0920 Residual 1.28 
Residual 256 1.6725 
0.05. 


from the first experiment also would apply 
the results from the second experiment. For 
this reason, the results from the cross-valida- 
tion experiment were not analyzed any great 
detail. 

Because the special significance the 
factor analysis operator tasks, however, 
was decided factor analyze the tasks for the 


cross-validation experiment the same manner 
that the factor analysis was conducted for the 
first experiment. comparison Table III 
with Table VIII reveals the high degree 
similarity between both the intercorrelation 
matrices and the factor matrices for the two 
replications, would expected from the 
above-mentioned correlation 0.97. 
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TABLE 
The Effect Coding Methods Operator Tasks 


Rank order code categories 


Tasks First Second 
Identify Numeral Letter 
13.64 13.02 
Locate Color Numeral 
8.46 7.42 
Count Numeral Color 
12.60 12.22 
Compare Numeral Color 
6.85 6.72 
Verify Numeral Color 
10.01 9.95 
Note: 


Third Fourth Fifth 
Shape Color Configuration 
12.34 
Letter Shape Configuration 
1.25 6.94 4.03 
Shape Letter Configuration 
11.49 11.11 7.07 
Shape Letter Configuration 
6.56 6.33 4.76 
Shape Letter Configuration 
9.50 9.05 6.60 


(1) Scores reported terms mean correct response per minute. 
(2) Code categories connected line are not significantly different 0.05. 


TABLE 


Effect Number Code Levels Operator 
Performance 


Number 


Mean number correct 
code levels 


responses per minute 


10.31 

8.76 

8.34 
TABLE VII 


Effect Target Density Operator Performance 


Target density Mean number correct 
(Number symbols per display) responses per minute 
11.36 
8.45 
120 7.60 


DISCUSSION AND CONCLUSIONS 


One the most important findings the 
study was the identification recog- 
nition and searching two independent 

operator tasks. There are several reasons why 
*this finding particularly important. First, 


suggests possible explanation for the seem- 
ingly discrepant results previous research. 
Second, helps explain the obtained inter- 
action between code categories and operator 
tasks. Third, strongly implies that recom- 
mendations given the design engineer con- 
cerning the design visual displays must 
based upon knowledge the tasks involved 
the system. Then, finally, the identification 
basic task factors should help establish 
more rigorous framework for future research 
visual displays. 

was pointed out above that, general, 
color coding and numeral coding were superior 
the other coding methods. This finding, 
course, was based upon upper limit only 
eight code levels. According the results 
previous research absolute identification 
hue, would seem highly likely that numeral 
coding—or even one the other coding 
methods—would superior color coding 
more than nine ten code levels were 
desired. 

The correlation 0.97 between replications 
permits rather high degree assurance 
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(a) Intercorrelations and residuals 


Identify 
Locate 
Count 
Compare 


Verify 


Identify 


0.03 
0.03 
0.00 
0.02 
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TABLE 


Intercorrelation Matrix and Factor Matrix for Tasks (for Second Replication) 


Locate 


0.06 


Vv 
~ 
0.53 0.56 0.23 
0.65 0.45 0.67 
0.80 0.69 
—0.04 0.73 
—0.03 0.07 


Correlations: upper right; residuals: lower left. 


(b) Unrotated factors 


Identify 0.50 0.60 
Locate 0.68 —0.51 
Count 0.92 0.06 
Compare 0.89 0.20 
Verify 0.81 —0.32 


Transformation matrix 


Rotated factors 


(38 degrees clockwise) 
Identify 
Locat 
0.79 
Compare 
Verify 


making recommendations from the results 
the study. apparent that the results the 
second replication could have been predicted 
almost perfectly from the results the first 


replication. 


Inasmuch different subjects 


were used the second replication and posters 
were replaced slides (which produced cer- 
tain noticeable changes the displays), 
certain amount generalizing warranted. 
The specific conclusions from the study are: 


(1) Searching and recognition are two inde- 
pendent task factors. This finding should 
kept mind when designing future 


experiments evaluate visual displays, 
well when making recommenda- 
tions concerning the design visual 


displays. 


(2) Within the limits the present study, 


color coding and numeral coding are the 
two superior coding methods. greater 
symbols, however, numeral coding 
superior color coding. For the re- 
maining tasks, there significant 
difference between color coding and 
numeral coding. 
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Evaluation the Effect 
Selected Combinations Target and 
Background Coding Map-Reading 


CHARLOTTE CHRISTNER, HORACE RAY, Battelle Memorial Institute, Columbus, Ohio. 


Performance—Experiment 


The objective this study was determine the relative effectiveness selected 
target-background coding combinations. Three target codes were: color, number, 
and enclosed shape. Five types background were: all white, solid gray, five shades 
gray, five pastel hues, and five different patterns. These target-background 
coding combinations were evaluated under eight different complexity conditions and 
for five different operator tasks. The major findings this study were: (1) 
significant differences were found background coding, (2) numeral coding 
superior for the task, and (3) color coding superior for the 


INTRODUCTION 


The coding cartographic display 
difficult for number reasons: 


(1) The amount information displayed 
necessarily relatively high because two 
sets (subject data and geographic 
data) are presented simultaneously. 
(2) Data are presented concurrently 
area limited size, with severe con- 
straints the designer’s freedom 
distribute the data over that space. 
(3) The number kinds and levels in- 
formation displayed sufficiently 
high tax the ingenuity the designer 
preparing matching number 
perceptual dimensions and steps. 
(4) The trade-off values are hardly known 
for 
(a) Increasing both the number cod- 
ing dimensions and steps simultan- 
eously, versus 

(b) Combining summarizing the basic 
information. 

(5) The arrangement the data figure- 
ground relationship raises possibilities 
significant interactions which have been 
found the studies perception. 


This work was sponsored the U.S. Air Force 
under Contract (602)-2078 (ref. 
201). 


The human-engineering evaluation carto- 
graphic displays also problem. Evaluations 
customarily are based such tasks single- 
target recognition visual search, with 
extremely high speed and accuracy require- 
ments. While such tasks are undoubtedly ele- 
ments more comprehensive map-reading 
map-interpretation task, they are surely not 
the only elements. Furthermore, the usual 
criteria may unrealistically high considering 
the over-learning and the availability such 
simple aids key legend which may 
present the real situation. 

Unfortunately, neither display 
nor map-reading performance are understood 
well enough permit specification the 
coding dimensions and steps used for 
cartographic display. Two general stipulations 

(1) Differences between figure and ground, 
among figures, and among background 
areas must somehow all maintained 
high level the same time. 

(2) There probably some point increas- 
ing display complexity beyond which 
additional coding dimensions are 
hindrance and the best coding dimen- 
sions are the simplest ones. 

The aim this study was evaluate the 

relative effectiveness the combinations 
certain selected coding dimensions for targets 
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and for backgrounds. Multi-dimensional codes 
were not considered this study. 


METHOD 


Fifteen simple coding combinations chosen 
for apparent human-engineering qualifications, 
were presented with different display com- 
plexity levels and tasks provide greater 
confidence the generalizability the results. 
Specifically, three variables considered repre- 
sentative complexity were presented two 
levels each, and the experimental task included 
five subtasks. 

Because the importance usually attached 


Colors 


Numerals 
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TABLE 
Munsell Notations for Colors Used Target Coding* 
Book 
notation production number 
999 
892 
1Y+ 946 
7GY 960 
1099 
1087 
1135 
3RP 1003 


All colors this set are from Munsell series 
maximum chroma. 
for sets four levels target coding. 


The three target codes. 


color for attention-getting, and because 
the technical difficulties high-speed produc- 
tion colored displays, major objective 
the study was determine the merits color 
coding relative black-and-white coding 
techniques. Consequently, color coding was 
used both for targets and for backgrounds. 


Target Coding 


Colors used for target coding were those 
recommended Conover and for 
eight- and four-step codes. (Munsell notations 
are indicated Table I.) The targets were 
squares with hairline black border. 


The targets have approximately the same 
saturation and brightness, and therefore the 
major distinguishing cues are differences hue. 

Numbers were selected preference 
plain shapes technique for target coding, 
the basis their previously demonstrated 
effectiveness 

The design enclosed shape targets was 
based eight the shapes recommended 
The solid black shapes were made 
into square targets enclosing each 
white area with 1-mm black border. 
Shape sizes were adjusted that the longest 
dimension each shape just fitted within the 
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borders the square. Selections were made 
from Sleight’s set order best discrimin- 
ability, except where seemed that discrimin- 
ability would greatly reduced through inter- 
action shape and border. One shape, the 
heart, was modified slightly increase the 
white area the square. was hoped that the 
enclosure the shape square would 
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conditions. The map was selected from 
atlas the basis two criteria: (1) should 
unfamiliar all subjects, and (2) should 
contain areas whose shape represented 
average degree irregularity, according 
the judgment the experimenters. The map 
selected was one West Central Asia con- 
taining areas depicting small sections 


Fig. Basic map areas without targets. 


enhance contrast effects and provide helpful 
redundancy information (see without 
increasing target area the extent that shape 
coding alone, but larger size, might just 
well have been used (see Bridgman and Wade).? 
The three target codes are presented Fig. 


Background Coding 


One basic map was used for all five coding 


Afghanistan, China, Iran, Iraq, Turkey, and 
the U.S.S.R. 

Because the actual area represented was 
significance the study, attempt was 
made present accuracy detail. The various 
provinces were treated individual units 
without regard the country which they 
belonged; water was not differentiated from 
land; and some simplification borders 
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resulted from tracing the map. Only sector 
outlines were traced: cities, rivers, and other 
map detail were entirely omitted. Map areas 
were designated single letters the alpha- 
bet and double letters through 
was omitted because possible confusion 
with the number “1”). The area “names” 
were labelled 3-in. white letters enclosed 
solid black circles ovals, located approx- 
imately the center each area. The map 
shown Fig. 

The five colors selected for background 
coding were expected provide maximum 
brightness contrast with the targets, while still 
maintaining high discriminability map 
sectors. Colors were assigned the back- 
ground areas randomly, with the restriction 
that adjacent areas should the same color. 
Munsell notations for these colors are pre- 
sented Table II. 


TABLE 
Munsell Notations for Colors Used Background 
Coding 
Hue 
8/4 2.5 (red) 
8/4 2.5 (yellow) 
8/4 2.5 (green) 
8/4 2.5 (blue) 
8/4 2.5 (purple) 


Various patterns such crosshatch, dots, 
and diagonal lines are common background 
codes. These not only make the areas map 
background discriminable, but theoretically 
may also improve target visibility. The pat- 
terns were selected the experimenters’ judg- 
ments discriminability. They were designed 
that they were nearly equal brightness 
when viewed distance which the patterns 
were longer discriminable. 

Grays varying levels were used for bright- 
coding the background. Munsell 
designation, these were 9.5/, 8/, 7/, 
6/, and 5/. With the exception the 
white 9.5/), all are separated equal inter- 
vals two steps. The white was separated 
from the nearest gray three steps provide 
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means showing basic differences map 
areas, water distinct from land. 

Even maps which not show areas 
different colors, patterns, etc., area coding 
shape, location, and usually name still exits, 
The map usually remains the same while the 
data symbols superimposed vary. Conse- 
quently, the most important function coding 
the different map sectors might show their 
extent, especially where the borders are irregu- 
lar where they are partially obscured 
heavy posting data. Considering these 
factors, one questions whether differential 
coding map sectors might detract more from 
efficient performance reason additional 
“clutter” the display, than would add 
efficiency increasing the distinctiveness 
areas. 

Accordingly, two conditions were used 
which map areas were distinguished only 
shape, location, and name. one case, all- 
gray map was used; the other, all white. 
The latter might have sufficed test for 
maps, but observations the experi- 
menters indicated that fairer test plain 
backgrounds might furnished gray 
background. Such background appeared 
give better contrast with two the target 
codes: enclosed shape and color. both cases, 
the appearance white color against the 
gray background seemed almost luminous. 


Complexity 


recognition the multidimensional 
nature perceptual complexity, number 
possible variables were listed, which seemed 
most likely interact with target-background 
coding. The variables were follows: 


Group 1—Target variables 

(1) Total number letters the map. 

(2) Absolute number targets. 

(3) Number coding dimensions. 

(4) Number coding levels for each dimen- 
sion. 

(5) Total area targets per total area 
display. 


in 


ORS 


CHARLOTTE CHRISTNER and HORACE RAY July, 1961 135 


(6) Clustering targets (targets packed 
closely together versus targets widely 
separated). 


Group 2—Variables relating linear features 
(1) Total length linear features such 
borders, coasts, rivers. 


(3) Number coding dimensions. 
(4) Number coding levels for each dimen- 
sion. 


evident that this list not complete, and 
that much work needs done conceptual- 
izing and defining cartographic density-com- 


Fig. Solid-gray background: high clustering, four coding levels, targets, color coding. 


(2) Extent which linear features inter- 
twine and criss-cross. 

(3) Number coding dimensions. 

(4) Number coding levels for each dimen- 
sion. 


Group 3—Area variables 
(1) (Perimeter)?/Area (an index form 
complexity). 
(2) Number areas. 


plexity variables. The aim the present 
study, however, merely investigate the 
effects selected target and map coding com- 
binations the performance assortment 
map-reading tasks. Therefore, only three 
these variables were used, two levels each. 
These were: 


(1) Number targets (60 and 120). 
(2) Number coding levels and 8). 
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(3) Clustering targets (high versus low). 


Number targets. This was simply the grand 
total all targets appearing one time 
30-in. display panel. The 60- and 120- 
target levels were chosen the basis 
previous being within range 
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that dimension, four eight different kinds 
targets appeared. 


Clustering targets. When one looks 
map, common see that some the 
targets are packed very closely together 
form target complex constellation (e.g. 


Fig. Patterned background: low clustering, eight coding levels, 120 targets, enclosed-shape coding. 


which significant effects performance might 
expected. 

Number coding levels. For each the three 
coding dimensions for targets, the number 
steps used was either four eight. The eight- 
level approaches the practical maximum 
ported for absolute discriminability hues. 
For any given display condition, only one 
target coding dimension was used, but within 


number NIKE sites placed around city). 
the other extreme, targets are often spread 
out over the entire map, might the case 
with Air Force bases. These extremes occur, 
even though the total number targets the 
map remains constant. 

order vary experimentally the degree 
which targets were clustered together, the total 
number targets for each condition was 
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divided into four equal-size groups, one group 
assigned each quadrant the display panel. 
For each quadrant, targets were placed within 
square within the quadrant size 
which clustered targets together closely 
clustered them together loosely. 

For the high-clustering condition, the 
square sub-area which the targets were 
placed was size such that quarter this 
sub-area was covered with targets. For the low- 
clustering condition, the sub-area which the 
targets were placed was size such that only 
twenty-fifth this area was covered. The 
selection these clustering levels was quite 
arbitrary, but appeared the experimenters 
result very crowded and quite uncrowded 
conditions. Examples target coding and 
complexity variables can seen Figs. and 


Experimental Task 


questions designed sample several subtasks 
considered basic map reading. The oper- 
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ations performed included locating, iden- 
tifying, and counting targets, well com- 
paring and verifying target data different 
areas. 


Experimental Design 


There were coding combinations repre- 
senting three target codes and five background 
codes. The evaluation these coding combin- 
ations was primary interest. Another set 
independent variables was the three complexity 
variables, represented two levels each. 
addition, there were five operator tasks and 
five subjects. These variables were 
factorially, yielding de- 
sign without replication. 

Table III presents all combinations target- 
background coding and the complexity vari- 
ables. These combinations represent the 120 
experimental conditions associated with 
changes the visual display. For each cell, 
time scores, accuracy scores, and number 
responses were recorded for each the five 
subjects, the same five subjects performing 


TABLE 
The Fifteen Coding Combinations and Eight Complexity Conditions 
Clustering: 1/4 1/4 1/25 1/25 1/4 1/4 
Number targets: 120 120 120 120 
Background: 
Color Color 
Color Number 
Color Shape 
All Gray Color 
All Gray Number 
All Gray Shape 
White Color 
White Number 
White Shape 
Patterned Color 
Patterned Number 
Patterned Shape 
Diff. Gray Color 
Diff. Gray Number 
Diff. Gray Shape 
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under each display condition. The experi- 
mental conditions the table were repeated 
five times, once for each task. 

addition the independent variables 
already discussed, certain control variables 
were included. First, there were five different 
categories information (defense units, army 
personnel buildings, aircraft, industry, and 
radar sites), all five the categories occurring 
each cell Table III. These same five cate- 
gories are described detail elsewhere 
Different categories were used order 
nullify any pre-experimental association be- 
tween particular target coding method and 
particular category information. 

prevent the subjects from learning the 
scheme arrangement the overlays and 
obviate the effect unintentional differences 
the make-up overlays for different condi- 
tions, two additional control variables were 
incorporated. First, the location target 
clusters each quadrant the display was 
determined randomization procedures, 
order that differences between display condi- 
tions could not attributed particular 
location targets the display. Second, the 
number each kind target each cluster 
was randomly determined. 


Equipment 

The five backgrounds were drawn 30x 
30-in. cardboard. order represent all 
combinations target coding, background 
coding, and the complexity variables, was 
found expedient place acetate overlays over 
the map backgrounds. Targets were made with 
Scotch-tape backing, and these targets were 
pasted the acetate. total 240 acetate 
overlays were needed order represent all 
the combinations the display variables. 


Question Booklets 


The basic types questions asked for each 
task can best understood referring the 
questions themselves, examples which are 
presented Table The Identify questions 
were multiple choice, with four alternatives. 
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For Locate, all area designators were listed 
under each question, and the subject was 
required circle all area designators which 
applied the question. 

Each phrase, number, area designation 
which Table indicates that 
these parts the questions changed, depending 
upon the make-up and placement target 
clusters, the category information, and the 
display condition. All changes were made 
randomly, not bias effects the inde- 
pendent 


RESULTS 
Performance Measures 


For the entire experiment, set 3000 time 
scores, 3000 error scores, and 3000 number-of- 
response scores were obtained. These scores 
complexity levels tasks subjects. 
Although each task was always represented 
three questions, the questions were timed 
unit, and the error scores pooled for each 
presentation the task. 

addition the performance scores, there 
were five rating-scale scores per coding condi- 
tion, which indicated the subjects’ preferences 
for the various coding conditions. 

examination the raw scores revealed 
that errors were negligible for all tasks except 
the Count task. Therefore, the primary 
analysis was conducted time scores and 
number responses. table the absolute 
errors for the Count task was later reviewed. 
Friedman chi square computed for the table 
whole was significant, but further 
statistical analysis was undertaken, since these 
data clearly would not produce results contra- 
dictory the findings from the analysis 
time scores and number responses. 

rate-of-responding measure was obtained 
dividing the number responses the 
time taken (in minutes). The logarithms the 
rate measures were then computed, and used 
the statistical analysis. Logarithmic scores 
were used order that average rate respond- 
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TABLE 


Questions for the Five Tasks 


Identify 


— 


What type(s) radar sites are CC? 


What two types radar sites are closest the area 


designation 


What are the two southernmost radar sites 


Locate 
Which area(s) contain only one 
Which area(s) have two, and only two, prisons? 
Which area(s) have four types targets 


Count 


How many barracks are the entire map? 


How many prisons and command posts are DD? 
Compare 
area AA, are there more prisons than command posts? Yes 
Are there more barracks than Yes 
thah barracks is? Yes 
Verify 
The army personnel building nearest the designation 
Area contains types army personnel buildings. 


ing could expressed terms geometric 
means, rather than arithmetic means. was 
believed that the geometric mean was superior 
the arithmetic mean, because the positive 
skewness scores often encountered when 
time scores are involved. 

Rate responding for the Identify and 
Locate task was based the number items 
circled the answer sheet. For the Count 
task, the total number items counted was 
used. For the Compare task, the number 
questions answered was used (i.e. three 
questions per trial). For the Verify task, the 
number targets dealt with was used base. 

Two major statistical analyses were con- 
ducted. analysis variance was performed 
determine the effects experimental 


conditions rate responding. addition, 
factor analysis was conducted the inter- 
correlations between the five tasks identify 
some the factors these tasks were tapping, 
and obtain better insight into the number 
and kind tasks which might used future 
studies visual displays for intelligence 
centers. 


Effect Experimental Conditions 


six-way mixed-model analysis variance 
with subjects the only random variable was 
conducted the log rate-of-response scores. 
The major results this analysis are sum- 
marized Table The table shows that all 
the main effects, except for Number Targets, 
were significant the per cent level. 
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TABLE 


Summary Analysis Variance 


Source variance Mean square Error term 
Coding combinations (A) 0.1574 
Number levels (B) 
Clustering (C) 
Number targets (D) 
Subjects (E) 

Task (F) 


9.1431 
0.8969 
0.1418 
0.6601 Residual 
47.6228 
0.0997 BCE 
0.0187 BDE 
0.0658 Residual 
1.4126 BFE 
0.0546 BAE 
0.0519 CDE 
0.0179 Residual 
0.5355 CFE 
0.0054 CAE 
0.0370 Residual 
0.2574 DFE 
0.0065 DAE 
0.0882 Residual 
0.7172 Residual 
0.0776 FAE 
0.0668 BCDE 
0.0332 Residual 
0.0483 BCFE 
0.0038 BCAE 
0.0191 Residual 
0.0184 BDFE 
0.0066 BDAE 
0.0281 Residual 
0.1590 Residual 
0.0086 BFAE 
0.0042 Residual 
0.1194 CDFE 
0.0044 CDAE 
0.0209 Residual 
0.0065 Residual 
0.0040 CFAE 
0.0535 Residual 
0.0139 Residual 
0.0041 DFAE 
0.0110 Residual 
0.0081 Residual 
0.0614 BCDFE 
0.0059 BCDAE 
0.0269 Residual 


— 


BCD 
BCE 
BCF 
BCA 
BDE 
BDF 
BDA 
BEF 
BEA 
BFA 
CDE 
CDF 
CDA 
CEF 
CEA 
CFA 
DEF 
DEA 
DFA 
EFA 224 
BCDE 
BCDF 
BCDA 
BCEF 
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Table V—continned 


Source variance Mean square Error term 
BCEA 0.0097 Residual 
BCFA 0.0044 BCFBE 
BDFA 0.0038 BDFAE 
BDEA 0.0063 Residual 
BEEF 0.0270 Residual 2.71* 
BEFA 224 0.0127 Residual 1.27* 
CDEF 0.0074 Residual 
CDEA 0.0072 Residual 
CDFA 0.0049 CDFAE 
CEFA 224 0.0086 Residual 
DEFA 224 0.0130 Residual 1.31* 
BCDEF 0.0234 Residual 2.35* 
BCDEA 0.0054 Residual 
BDEFA 224 0.0091 Residual 
CDEFA 224 0.0107 Residual 1.08 
BCEFA 224 0.0079 Residual 
BCDFA 0.0008 Residual 
Residual 224 0.0100 

0.05. 
TABLE 


Duncan Multiple Range Tests Applied Geometric Means Response Rates for Each Five Tasks 
Rank Orders 


Identitfy: 16.81 16.60 16.53 16.33 16.27 16.09 15.99 14.95 


Target No. No. No. No. No. Color Color Shape Shape Shape Color Shape Color Shape Color 
Background AllG. Diff.G. White Patt. Color AllG. Patt. White Color AllG. White Diff.G. Diff.G. Patt. Color 


Target Color Color Color Color Color No. No. No. No. No. Shape Shape Shape Shape Shape 
Background Diff.G. White Patt. AllG. Color Patt. Diff.G. Color White AllG. AllG. Patt. White Diff.G. Color 
Count: 41.68 41.42 39.88 39.76 39.08 28.99 28.99 28.71 28.52 2849 28.48 28.38 28.09 28.05 28.00 


Target Color Color Color Color Color Color No. No. Shape Shape Shape No. No. No. Shape 
Background Diff.G. AllG. Patt. White Color Diff.G. Diff.G. White White Color AllG. AllG. Patt. Color Patt. 


Target No. Color Color Shape No. No. Color Shape No. Shape Shape Shape 
Background Patt. AllG. AIG. White Diff.G. Patt. Diff.G. Diff.G. White Color AllG. Color Color White Patt. 


Target Color Color No. No. Shape No. Color No. No. Shape Color Shape Color Shape Shape 
Background AllG. White AllG. Patt. Diff.G. Diff.G. Diff.G. White Color AllG. Patt. White Color Patt. Color 


Notes: 


(1) Numbers connected line are not significantly different 0.05. 
(2) Abbreviations: 
All G 


=All gray. 
Diff. G .= Different shades of gray. 
Patt. = Patterned. 
No. = Number. 


i 
q 
.06* 
.79 
= 
.08 
70* 
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Coding combinations. Primary interest this 
analysis centers the effects the coding 
combinations operator performance, and 
the consistency these effects over different 
complexity and task conditions. Table 
shows significant main effect for coding com- 
binations. The only significant interaction 
with coding, excluding interactions which 
include subjects, the double interaction with 
task. Consequently, the coding combinations 
were not examined relative the complexity 
conditions, but were examined only relative 
task. 

The significance differences between cod- 
ing combinations was tested for each task 
the Duncan multiple range The results 
are shown Table VI. Each block the 
table represents one the five tasks. Within 
each block the coding combinations are listed 
horizontally order merit with the highest 
geometric mean response rate shown the 
left, and the lowest shown the right. Within 
each row, underline marks show those means 
which are not significantly different from one 

clear from Table that numbered 
targets are superior for the Identify task, and 
colored targets are superior for the Locate and 


4-1/25 


TABLE 


Geometric Means Responses per Minute for the Density Conditions, Broken Down Task 


Identify 
4-1/4 
18.06 18.53 16.17 16.64 
18.80 20.36 15.99 15.83 


Count 
4-1/25 4-1/4 8-1/4 
35.04 42.91 20.27 25.22 
39.56 54.73 20.55 32.07 


Verify 
4-1/4 
19.93 
25.28 
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Count tasks. For all task and target coding 
combinations, the background codings not 
differ and for Compare and Veri- 
fy, there are significant differences among 
any the coding combinations. 

Complexity conditions. There are significant 
non-subject interactions between coding com- 
binations and any the complexity variables 
except the double interaction with task. When 
the density variables are considered, however, 
each density variable interacts significantly 
with the other two density variables, and each 
density variable interacts with task. Conse- 
quently, the effects the density variables 
were studied combination with themselves, 
and combination with task. The data are 
summarized Table VII. 

general, the effect increasing the num- 
ber kinds targets from four eight 
decrease the rate responding, might 
expected. This effect especially pronounced 
the case the Count task. 

Clustering targets related appre- 
ciable improvement performance for only 
the Count task, especially with 120 targets, for 
both and levels coding. sizeable im- 
provement also occurs the Verify task under 
the 120-target, 4-levels condition. appears 


Locate 
4-1/25 8-1/4 
8.64 10.31 6.45 6.33 
9.13 9.23 6.54 6.00 


Compare 
4-1/25 8-1/4 
120 6.59 6.81 7.36 6.04 


16.43 
18.11 


8-1/4 
17.77 
20.02 
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that the clustered condition permits the oper- 
ator deal with target groups rather than with 
single targets. This would enable him 
handle them faster rate, especially count- 
ing, which case may count 2’s 3’s 
rather than 1’s. 

was most interesting note that, under 
certain conditions, performance tends 
improve the total number targets in- 
creases. This effect found approximately 
half the comparisons Table VII. Consider- 
able increases are found for Count with the 
exception the condition. increase 
can seen for the Verify task, except for 
levels and clustering 1/25. 


Relation Between Tasks 


has been evident all the experiments 
the current research program that the particular 
task being performed the operator 
important consideration the evaluation 
display characteristics. the present experi- 
ment, the task Variable not only had signifi- 
cant main effect, but also entered into number 
significant interactions. 

Because the significant effect the task 
variable, and because its importance the 
simulation real operations, additional 
analysis was made determine some the 
basic factors which account for variations 
the five tasks. Thurstone’s centroid method 
factor was used extract three 
factors. These three factors were rotated 
graphic techniques simple orthogonal struc- 


Intercorrelations and residuals* 


0.36 0.35 0.15 
0.01 0.01 0.04 


Correlations: upper right; residuals: lower left. 


TABLE Vili 


Intercorrelation Matrix, Residual Matrix, and Rotated Factor Loadings for Five Tasks 
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ture, and one further rotation was made the 
basis enhancing psychological meaning- 
fulness. 

The data for the factor analysis are sum- 
marized Table VIII. The matrix the left- 
hand side the table shows, above the dia- 
gonal, the original intercorrelation matrix for 
the five tasks (Identify, Locate, Count, Com- 
pare, and Verify). The tasks were correlated 
over the mean performance for each the 120 
display conditions for each task. Below the 
diagonal the final residual matrix. The factor 
loadings and the communalities for each 
task are shown the four columns the 
right-hand side the table. 

appears general factor, but with higher 
loadings Identify and Verify, than the 
other three tasks. The generality this factor 
seems representative the requirement 
recognition, which necessary part 
each task, but which larger part Identify 
and Verify than the remaining three tasks. 

Its highest loadings are Locate and Count. 
The Locate task requires the operator scan 
the map and then check list the areas 
which contain certain types targets. The 
Count task requires the operator scan one 
area for two kinds targets, four areas for one 
kind target, the whole map for one kind 
target. seems clear that these two tasks 
would have high loadings factor, 
and that the other tasks would have much 


Rotated factors 


(Identify) 0.64 0.09 
(Locate) 0.26 0.68 0.62 0.91 
(Count) 0.40 0.89 
(Verify) 0.68 0.43 
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lower loadings. moderately high loading for 

Verify, however, not apparently appro- 
priate. This loading may related the fact 
that the Verify questions were all 
questions with very few items (either targets 
map areas) remembered enumerated. 
All three questions referred single area 
each, with the area being designated within the 
question. Consequently, there can very 
little else this task beyond finding the 
appropriate area. 

although might have been called 
Its highest loading the Locate task, which 
has already shown high loading the Search 
factor. was not immediately apparent what 
the nature this factor might be. review 
the operations associated with the performance 
Locate, however, revealed frequent shift 
head position necessitated the need refer 
back the question sheet periodically check 
off areas from the thirty listed below the 
question. moderate loading the Compare 
task interpreted indicating the need for 
referring back the questions, since every 
question dealt with two areas and one class 
targets with two classes targets and one 
area. 

The presence again, under altered conditions, 
the Recognition and Search factors found 
Experiment increases confidence the 
validity these factors. Their basic meaning- 
fulness attested the finding that colored 
targets are superior for Locate and Count (high 
loadings the Search factor) and numerical 


Targets Mixed 
Color grays 
Color 6.8 
Number 8.4 9.4 
Enclosed shape 6.8 9.6 
Average rank 
over targets 7.33 7.50 


TABLE 


Preferences Ranks Averaged Over Five Subjects for Fifteen Code Combinations 
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targets are superior for Identify (high loadings 
the Recognition factor). There are 
differences performance, far colored 
targets versus numeral targets concerned, 
for Compare (no appreciable correlation with 
either Search Recognition) and for Verify 
(high loadings both factors). 

The third factor, Remembering, seems 
related more the structure the operator’s 
work, and the quantity data dealt 
with one time, than the design the 
display unit. suggests further research 
time-saving features for use when many items 
must recorded, when different kinds 
data must studied the same time. 


Preferences 


Preference ratings for the coding com- 
binations were obtained from the five subjects 
the conclusion the experiment. These 
ratings were converted rank-order data, and 
Friedman’s chi square® was used test the 
significance differences among ranks for the 
total table. This test showed that the com- 
binations whole differed. The same test 
was then applied separately background 
codes and target codes. Background codes 
did not show significant difference, but target 
codes did. 

summary the preference rankings 
presented Table IX. cursory examination 
the table reveals the subjects’ pronounced 
preference for colored targets. will .be 
recalled that the colored targets were associated 
with superior performance the Locate and 


Backgrounds 
Average 
rank over 
gray White Patterned backgrounds 
4.1 3.9 4.36 
8.8 9.8 13.5 9.98 
10.2 9.6 12.1 9.66 
7.70 7.63 9.83 
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Count tasks, both which were highly corre- 
lated with the Search factor. These two tasks 
were also the two longest terms absolute 
time for completion. Consequently, 
wonder the subjects preferred the attention- 
getting colored targets when much their 
time was spent the Search type task. 
Had the total task been more heavily loaded 
with Identify questions (and the Recognition 
factor) possible that the preferences might 
have been for numerals rather than for colored 
targets. 


DISCUSSION AND CONCLUSIONS 


the interpretation the results this 
study, the particular circumstances the 
experiment must kept mind. limited 
scope the kinds coding combinations 
studied, the types and degrees complexity, 
the structure the operator’s task, and the 
range coding techniques naturally restricts 
the generalizability results. 


Operator Tasks 


The question what kind task give 
the operator the experimental setting 
great importance. The task selection this 
study was based the experimenters’ ideas 
about what tasks would involved working 
with cartographic display. study actual 
operational activities would enable future 
experimenters incorporate tasks that would 
better simulate reality. This worth-while 
goal view the significant interactions 
between tasks and coding techniques. 

The importance selecting appropriate 
operator tasks further pointed the 
unusual finding that for some tasks increase 
the total number targets shown the 
display results faster rate performance. 
This result did not occur for all tasks, however. 
result that never would have been found 
many visual display studies, since such 
studies are based tasks such identifying 
single flash target quickly possible, 
finding previously known and unique target 
which embedded mass other targets. 
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The factor analysis tasks must viewed 
with certain limitations. First, would 
number tasks, representing wider 
human-operator functions visual dis- 
plays. Second, would better correlate 
tasks over wider range visual display 
conditions. Both these improvements would 
probably result larger number factors, 
with better definition and interpretation each 
factor. would then possible develop 
tasks which are reasonably “pure” factorially. 
turn, such tasks would result in: 


(1) more meaningful and generalizable 
interpretation the effects display 
variables performance. 

(2) more meaningful interpretation task- 
display parameter interactions. 


Subject Differences 


The interactions between subjects and dis- 
play parameters indicate individual differences 
responses coding techniques and the 
complexity visual displays. While the nature 
and extent such differences were not studied 
detail this experiment, the significant 
interactions warrant further study. For exam- 
ple, there definite possibility that coding 
scheme which best judged averages 
taken over number operators, may not 
best for certain individual operators. this 
were found the case, would possible 
for the wrong operator duty 
crucial time. 


Color Coding 


Because the practical problems generat- 
ing and transmitting color-coded displays, and 
because general belief that color coding 
desirable, there has been particular interest 
the relative efficiency performance with 
color codes. For the Identify task, number 
coding was superior color coding, which 
agreement with Hitt’s findings. For both 
Locate and Count, however, color coding was 
superior number; but Hitt’s study, 
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significant differences were found between 
color and number coding for these two tasks. 
Perhaps the discrepancy can explained 
part the greater display complexity involved 
the present experiment, which would tend 
enhance the attention-getting qualities 
color. Also, there were certain differences 
between the two studies with respect the 
type Count and Locate questions used. 

With regard background, colored back- 
grounds did not differ significantly from non- 
colored backgrounds. addition, the four 
black-and-white backgrounds did not differ 
significantly among themselves. Thus, 
would appear that the choice background 
would depend upon such factors ease 
construction and economy. 

favor color coding the fact that 
numbers might held reserve used for 
numerosity indicators, possibly conjunction 
with some other code. Arguments against the 
use color include: (1) the possibility color- 
deficient vision among operators; and (2) 
number unanswered questions; for instance, 
there may other untried codes that would 
well. 

The following conclusions apply only the 
conditions used this study: 


(1) There are differences 
between the selected background codes. 

(2) The choice target codes depends upon 
the task performed. 

(3) For targets, color coding superior for 

Locate and Count tasks; numeral coding 

superior for the Identify task. 
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(4) Subjects preferred color targets 
numeral and shape targets. 


(5) Coding combinations 
conditions not interact. 

(6) Intercorrelations between the five tasks 
included the study may explained 
terms three factors: Recognition, 
Search, and Remembering. 


REFERENCES 


tation Information, Technical Report 
Wright Air Development Center, Wright-Patterson 
Air Force Base, Ohio, August, 1954. 

Letter Size for Given Display App/. Psychol., 
40, 378-380, 1956. 

CHRISTNER, CHARLOTTE A., G., and 
Ray, W., Some Factors Affecting Visual Search Time for 
Symbols Large Visual Display. Paper presented 
the Annual Convention, American 
Association, Cincinnati, Ohio, September, 1959. 

Conover, W., and L., The Use 
Color Coding Displays, Technical Report 
55-471, Wright Air Development Center, Wright- 
Patterson Air Force Base, Ohio, August, 1954. 

Duncan, B., “Multiple Range and Multiple 
Tests”. Reprint Series No. 49; reprinted from Biome- 
trica, (1), 1955. 

Frrrs, H., Stimulus Characteristics Determining 
Speed Classifying Visual Minutes and Pro- 
cedures 35th Meeting Armed Vision 
Committee (1954), Ann Arbor, Michigan; Armed 
Vision Committee Secretariat, University 
Michigan, pp. 1959. 

Five Different Abstract Coding Methods” (present 
edition this journal). 

F., Design and Analysis Experi- 
ments Psychology and Education, Houghton 
Company, Boston, 1953. 

F., Some Rapid Approximate Statistical 
Procedures, American Cyanamid Company, New York, 
1949. 


Tra 
hav 
int 
auc 
ma 
cul 
dit 
tra 
on 
tas 
Ni 
| 1 


-160, 


mum 
chol., 


and 
for 
gical 


Ise 
ight- 


Pro- 
ision 
rmed 


stical 


The Authors 


DARWIN HUNT (The Effect the 
Precision Informational Feedback Human 
Tracking Performance) research psychologist 
the Engineering Psychology Branch, Be- 
havioral Sciences Laboratory, Wright Air De- 
velopment Division. has served this 
capacity since 1951 and has published research 
the areas control coding, tactual guidance, 
audio warning systems, learning theory and 
human tracking dynamics. 

Dr. Hunt received his B.A. degree (mathe- 
matics and psychology) from Miami University 


(Ohio) 1950. was awarded his Ph.D. 


degree (experimental psychology and statistics) 
Ohio State University 1960. Dr. Hunt 
currently responsible for research program 
directed toward determining the influence 
transformations displayed error information 
the ability humans perform various 
tasks such controller functions. 


CHRISTNER, RAY and COF- 
FEY (Development Design Criteria for In- 
telligence Display Formats) 


JOHN COFFEY Comparison Ver- 
tical and Horizontal Arrangements Alpha- 
numeric Material [Experiment I]) member 
the human factors research group Bat- 
telle’s Systems Engineering Division. His 
major interests are experimental and en- 
gineering psychology. Mr. Coffey received his 
B.S. and M.S. degrees psychology from the 
Ohio State University, where presently 
working toward his Ph.D. degree psycho- 
logy. When Mr. Coffey joined Battelle 1955, 
worked senior technician non-ferrous 
physical metallurgy. Since joined the human 
factors group September, 1959, has been 
engaged research large-scale visual dis- 
plays and research aural reading devices. 
His work visual involved the design, 
conduct, and analysis experiments alpha- 
numeric presentation intelligence informa- 


tion. the area aural reading devices, 
has actively participated the development 
improved hardware, better tracking techniques, 
and improved training procedures. 


HOWARD SCHUTZ (An Evaluation 
Formats for Graphic Trend Displays [Experi- 
ment and Evaluation Methods for Pre- 
sentation Graphic Multiple Trends [Experiment 
senior psychologist the biosciences 
research group Battelle Memorial Institute. 
His major interests are physiological and 
experimental psychology. did his under- 
graduate work the University Illinois and 
received his M.S. and Ph.D. degrees physio- 
logical and experimental psychology from the 
Illinois Institute Technology 1952 and 
1955, respectively. Before joining Battelle 
1957, Dr. Schutz served for five and half 
years research psychologist for the Quater- 
master Food and Container Institute. His 
research activities were the areas taste, 
odor, appetite, and food preferences. Since 
joining the staff Battelle, Dr. Schutz has 
worked projects design visual displays, 
console layout, basic mechanisms olfaction, 
and sensory evaluation products. Dr. Schutz 
member many technical and professional 
societies, including the American Psychological 
Association and the Human Factors Society. 
member Sigma Xi. has pub- 
lished more than twenty technical reports and 
the general area applied experi- 
mental psychology. 


WILLIAM HITT Evaluation Five 
Different Abstract Coding Methods [Experiment 
See page 171, Human Factors, August, 
1960, Vol. No. 


HORACE RAY Evaluation the 
Effect Selected Combinations Target and 
Background Coding Map-reading Performance 


[Experiment 
147 


ined 
> 
q 


148 July, 1961 


CHARLOTTE CHRISTNER, Project 
Leader, Systems Engineering Division, 
experimental psychologist with major interests 
visual displays and information handling 
large-scale systems. She graduate 
Miami University and the Ohio State Uni- 
versity. Dr. Christner joined Battelle 1956. 
Prior joining the Battelle staff, Dr. Christner 
had experience variety psychology 
problems, including motor skills, human en- 
gineering, and statistical analysis. One her 
first interests Battelle was systems research 
electronic countermeasures. While she has 
assisted variety projects, her work has 
been concerned primarily with human-factors 
problems large semi-automatic systems. 
particular, this has focused studies visual 
displays and information handling. Dr. 
Christner member the Human Factors 
Society, the Central Ohio Psychological 
Association member the board direc- 
tors), The American Psychological Associa- 
tion (Division 8—Personality and Social 
Psychology, and Division 21—The Society 
Engineering Psychologists), and the High- 
way Research Board. 


HORACE RAY. See page 172, Human 
Factors, August, 1960, Vol. No. 


NOTE: The following three bio- 
graphies were received too late for inclusion 
Vol. No. March 1961 issue. 


ROBERT JOHNSON, DONALD 
GORDON, BRUCE BERGUM, and WAYNE 
PATTERSON (COED—A for the Ex- 
perimental Study Man-Machine Systems) 


Department Head, Data Processing and Sys- 


HUMAN 


tems Department, Bendix Systems 


Ann Arbor, Michigan. this position, 


made substantial contributions the 


systems design the EAGLE, and 


contemporary missile systems. Prior works 


ing Bendix, held positions Pratt and 
Whitney, and the RADC missile 
laboratory. received his B.S. the 


versity Illinois, and holds masters degrees 
aeronautical and instrumental engineering 
(both 1954) from the University 


DONALD GORDON Head the 
Experimental Simulation Group, Data 


ing and Systems Department, Bendix 


Division, Ann Arbor, Michigan. Prior his 
present position, was assistant professor 
psychology the University Illinois, and 
held positions the Personnel Research 
Branch, TAGO, and the Engineering 


Research Institute, University 
received his Ph.D. psychology 


from Columbia University. 


BRUCE BERGUM research scientist 
the Human Research Unit (HumPRO), 
Fort Bliss, Texas. was formerly Head, 
Human Factors Group, Data Processing and 
Display Department, Bendix Systems Division, 


and has held teaching positions with North- 


western University and the University 


Illinois. Dr. Bergum has worked training-and 


maintenance research for the Air Force 


Personnel and Training Research Center and 
currently engaged research 
system operator problems. received his 
M.S. experimental psychology 1953 and 
his Ph.D. 1958 from Northwestern Uni- 
versity. 


\ ig 
| 


